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The properties of a stochastic model for the predator-prey type 
of interaction between two species 


By P. H. LESLIE anp J. C. GOWER 


Bureau of Animal Population, Department of Zoological Field Studies, Oxford, 
and the Statistical Department, Rothamsted Experimental Station 


1. INTRODUCTION 


The two main types of interaction between any pair of biological species, which are of 
most interest to the ecologist, are either when they are competing together for some common 
source of food supply, or when one of the species preys upon the other. The properties of 
a stochastic model for a system of two competing species have been illustrated by a set of 
artificial realizations in an earlier paper (Leslie & Gower, 1958). We now consider some of the 
properties of a model for the interaction between a predatory species and its prey, more 
particularly in regard to the behaviour of such systems in the region of the stationary state, 
and the chances of random extinction for one or other of the two species. The interaction is 
imagined to take place in some limited environment where there is an ample supply of 
food for the prey, and in the first place it is assumed that all the members of the prey popula- 
tion are exposed to the risk of capture or attack by the predator. Later, this last condition 
is relaxed, and it is supposed that because of some heterogeneity in the environment, only 
a fraction of the prey population is exposed to risk, and some of the consequences of this 
partial interaction are illustrated in the last section. The basic model has already been 
described (Leslie, 1948, 1958), but it will be useful if the formulae are summarized here. 

If S, is a species of prey and S, a predator, then working in discrete-time intervals and 
given that the respective populations consist of N,(¢) and N,(¢) individuals at time t, the 
deterministic model for the interaction is taken to be, 


7 A, N,(t) 
lide ial eT Ni) +A, NO)’ 1-1 
M+) = - 
2 ~ 1+ a%g{NQ(t)/N,(t)}” 


where «,, £, and «, are parameters > 0, and log,A, = r, = b, —d,, log, A, = r, = b,—d, are 
the intrinsic birth- and death-rates of the two species. For the stationary state, N, =L,, 
N, = L,, we have, 
L, a (A, — 1) : | 
By(Ag— 1) + 04%" | (1-2) 
Ly = (Ag—1) Ly]. 
It has been shown (Leslie, 1948, § 6) that this discrete-time model is closely related to the 
continuous-time model, (writing the operator D = d/dt), 


(a1, 2, ¢, > 9), (1-3) 
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for which the stationary state is  L, = —“?"1_, 
C1 1g +A Ay (1-4) 


Putting N, = L,(1+4,) and N, = L,(1+u,), then we have from (1-3) for small u, and ug, 


Du, = ne rene (1:5) 
Dtig = 1 2(Uy — Ug). 

The equation in D is D? +(r.+a,L,) D+r,(a,L,+¢,L2) = 0, 

or from (1-4) D? + (r+a,L,)D+ryr. = 0. (1-6) 


The roots of (1-6), therefore, will be either both negative, or complex with the real part 
negative, so that the stationary state is stable, and an approach to this state will be made by 
a series of damped oscillations if 
(rg +4,L,)? < 4ryro. 
The properties of this model differ somewhat from those of the classical Lotka—Volterra 
equations for this type of interaction, viz. 


DN, = (€:—1N2) N, 

DN, = (—€2+¥2N,) Nz 
This deterministic system and the stochastic model based upon it have been discussed 
recently by Bartlett (1957a). Here there is no damping towards the equilibrium point 


Ly = €/72, Le = €/y1, and the deterministic path of small cycles around this point is given 
by the ellipse 


} (€1,€2, 1» Y2 > 9). (1-7) 


€,U; + €,u2 = constant, 


where N, = L,(1+ 4), N, = L,(1+u,). Consequently, as Bartlett points out, in the stochastic 
model the effect of random drift, in the absence of any damping factor, must result sooner 
or later, either in the extinction of the predator, or in the extinction first of the prey, 
followed in due course by that of the predator from starvation. In the stochastic formulation 
of this model (1-7), the stationary state is therefore in a sense unstable. But the presence 
of a damping term in the model defined by (1-3) would lead to a greater degree of stability, 
and in the corresponding stochastic model the system might therefore be expected to 
fluctuate in the region of the equilibrium state, although there might be still a chance of 
random extinction of one or other species, depending on the degree of variability in numbers 
in this region. To investigate this point, the stochastic discrete-time model corresponding 
to (1-1) was programmed for the Elliot-N.R.D.C. computer in the Statistical Department 
of Rothamsted Experimental Station, and some of the results obtained are given in the 
following sections. 
2. STOCHASTIC MODEL 


In a stochastic formulation of this model, a wide variety of possible birth-rate and 
death-rate functions for the two species could be adopted (cf. Leslie, 1958, §4). But, 
clearly, one of the most obvious choices to make is the case when the birth-rate (b) of each 
species remains constant, and any increase in the numbers of the predator affects the death- 
rate (d,(t)) of the prey over the interval ¢ to ¢+1, and vice versa. If, therefore, in (1-1) we 
define the parameters representing the intrinsic birth- and death-rates of the two species, 


A, =ee-4e (a = 1,2; 56, >d,), 
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Properties of a stochastic model 221 
and put q(t) = 1+a,N,(t)+f,N,(), 
qa(t) = 1+ %{N,(t)/N,(4)}, 


we have in the constant birth-rate type of discrete-time stochastic model (Leslie, 1958, § 5), 


BIN (+1) [NO N(0} = AH NO) = ANG) (= 1,2), 
241) (Ad) EMt+D} alt) +1) 


= 2b, B{N,(t+1)} (A(t) = 1). 


var {N, (+1) | N,(t), Na(t)} = (2-1) 


Here it is assumed that the difference between the constant birth-rate and the variable 
death-rate of each species at time ¢, 


r(t) = log, [Aa/a(t)] a 6, —d,(t) (a =1, 2) 


remains constant over the interval ¢ tot + 1, and that given N,(t) and N,(t), then N,(¢+ 1) and 
N,(t+1) are distributed normally and independently with these means and variances, all 
negative values of N,(¢+ 1) being attributed to N,(¢+1) = 0. 

The programmes for this model were similar to those described by Leslie & Gower (1958) 
for a system of two competing species and little need be said of them here. In particular the 
same method of random number generation was used and the population parameters could 
easily be varied. Since the results consisted largely of long trajectories of the population 
numbers of the two species at succeeding instants of time, an additional programme was 
written to construct distributions of these population numbers direct from the output tapes. 


3. THEORETICAL VARIANCES AND COVARIANCE OF THE SYSTEM 


The theoretical variances and covariance of the population numbers, when such a system 
is fluctuating in the region of the stationary state, may be estimated, to a first approxima- 
tion, in the following way. The equations (2-1) may be written in the form 


N,(t+ 1) = fi(Ny, Ng, t) + Z(t +1) (a = 1, 2) (3-1) 


in which the first term is the deterministic part of the process defined by (1-1); and the 
Z(t +1) are independent normal variables with zero means, and variances, 0°(Z,) ~ 2b, L,. 
when the birth-rate of each species remains constant, and the system is in the region of the 
stationary state (L,,L,) defined by (1-2). By applying the usual d-technique (cf. Leslie & 
Gower, 1958, §5), we have as a first approximation from (3-1), the set of equations for 
determining var (N,(¢)) = o%, var (N,(t)) = 73 and cov (N,(t), N2(t)) = O12; 


t= (2) e ot +2() (3) out (21) of +20,La, 
= (foo) (rue (8) tear | 0 


r= (AL) lo) 





14*2 
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the partial differential coefficients being evaluated for N, = L,, N, = L,. Thus, from (1-1) 
and (1-2), we have 
ff ae al AM 
1 14a,N, +8,’ 





ALN, 


f= 1+aN,/N,’ 
of, ) a,D, ( of: :) 1 
and 94 ai-, i -“—, 
(cx, LyLy A ON) 1,1, Ae 
(2) _ ily (3) _ As—1)* 
ON. Inka A,’ \eN, Le. AAs 


It is also useful to have the equations for determining the variances and covariance for 
the analogous continuous-time model. From (1-5), writing c, = ka,, we have the linear 
stochastic system for small uw, and w,, 
du, = a Raita: ee) (33) 
Jug = (Uy —_ Uy) ot + od, 


in which the independent variables 6 and é6¢ have zero means, and variances (2b,/L,) dt 
and (2b,/L,) dt, respectively, when the birth-rate of each species is assumed to remain con- 
stant and the system is in the region of the state (Z,, Z,). From u,+ du,, ua + due, we finally 
obtain, by squaring and taking the cross-product, the equations for the variances and 
covariance (0%, 73, 0») of u, and ug, 

b 

b (3-4) 





(4, L1+12) Oy. = 720} — ka, L, 03. 
Since N, = L,(1+ 4), N, = L,(1+u,), we then have 
var (N,) = L?var(u,), var(N,) = Livar(u,), cov (N,, N,) = L,L, cov (uy, us), 


which can be contrasted with the variances and covariance for the discrete-time model given 
by (3-2). The relationships between the parameters of the two types of model are 


1¢= log. Aq (a = 1,2), a= 4 7y/(Ay—1) and k= By )%; 


while the constant birth-rates b, and b,, and the stationary values, L, and Lg, are naturally 
the same for each model. In regard to the differences between the two models, it is perhaps 
worth noting that the variances estimated hy means of (3-4) are always less than those 
obtained by the solution of (3-2), so that the use of the discrete-time model leads to an 
enhanced degree of variation when a particular system is fluctuating in the neighbourhood 
of the equilibrium level (cf. Bartlett, Gower & Leslie, 1960). By reducing the unit of time 
adopted in the discrete-time model, however, it is always possible to make the variances of 
the two types of model more in agreement. 
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4. FLUCTUATIONS IN THE NEIGHBOURHOOD OF THE STATIONARY STATE 


The behaviour of this type of system in the region of the stable stationary state may be 
illustrated by the results obtained from a realization which was computed for 1000 steps, 
taking as the numerical values of the parameters in (2-1) 


A, = 1-2574, 6b, = 0-2577, A, = 1-1892, 6, = 0-2521, 
a, = 00005148, ,=0-0018018 and a, = 0-2838, 


which from (1-2) give a stationary state of L, = 150, L, = 100. Starting with the initial 
values of N,(0) = 500 for the prey, and N,(0) = 20 for the predator, these processes rapidly 
approached their equilibrium levels, in the region of which they then continued to oscillate 


250r 
200} 
150 


N (t) 
100 





50F 








L 1 1 1 J 
°00 30 40 50 60 70 80 90 100 110 120 130 140 
Time (t) 
Fig. 1. Fluctuations of a predator-prey system in the region of the stable stationary state. 


———-~, the number of prey (equilibrium level L, = 150); , the number of predators 
(equilibrium level ZL, = 100). 





in an irregular fashion. As an example, the changes in numbers are illustrated in Fig. 1 for 
the period of time from ¢ = 20 to ¢ = 140. It will be seen that there is no regularity in the 
oscillations, and that at times there is a tendency for quite a pronounced excursion to be 
made away from the region of the stationary state, for exampie, in Fig. 1 the course of events 
from about t = 100 tot = 120, when a large fall in the numbers of the prey is followed shortly 
afterwards by a similar type of fall in numbers of the predator. The general picture is 
somewhat different from that of a system of two competing species with a stable stationary 
state (Leslie & Gower, 1958), where any drift away from the equilibrium level seems to 
take place in opposite directions owing to the negative correlation which exists between the 
two species in that type of system. In the case of the predator-prey type of interaction, 
the correlation is positive in sign. 

Theoretically, it might be expected that the stationary distribution of such a two-species 
system would be approximately bi-variate normal in form, with variances and covariance 
given by (3-2), (Bartlett, Gower & Leslie, 1960). The bivariate distribution of N,(¢) and N,(¢) 
is given in Appendix Table 1 for the last 800 steps in this realization. The observed means 
were V, = 149-74 and N, = 97-09, compared with the deterministic stable state of L, = 150, 
L, = 100; while the observed variances and covariance (computed by the machine from the 
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individual observations and not from the grouped data), together with the values expected 
theoretically both for the discrete-time model, and for its continuous-time equivalent, were: 





Expected 
— A Observed 
f Continuous-time Discrete-time Discrete-time 
model model model 
var (N,) 432 546 635-6 
var (N,) 170 228 214-0 
cov (N,, Nz) + 37-2 + 56-6 + 63-6 


Considering that the expected values are based on the theory of small fluctuations and so 
cannot be exactly correct, the agreement in the case of the model actually used seems very 
satisfactory. 

For samples as large as 800, taking g, ~ m,/mé and g, ~ [(m,/m3) — 3], we have (applying 
Sheppard’s corrections in computing the moments) for the marginal distribution of N, in 
Appendix Table 1, 

g, ~ +0°322+0-087, g. ~ — 0-035 + 0-173, 
and for that of N,, g, ~ +0:121+0-087, g. ~ —0-201 40-173. 


The skewness coefficient for the second species is not much different from zero, while that 
for the first species is 3-7 times the standard error given, suggesting a degree of positive 
skewness in the marginal distribution of N,. These standard errors, however, are the 
classical values, viz. o(g,) = ,/(6/n), ignoring the serial correlation between the successive 
values of both N,(¢) and N,(t). They are therefore underestimates of the correct values 
(Bartlett et al. 1960). In any case the degree of skewness is not very marked, and broadly 
speaking, we can regard the distribution given in Table 1 as being approximately bivariate 
normal in form. 


5. THE CHANCES OF RANDOM EXTINCTION 


In the numerical system used as an illustration in the previous section, the chance of one 
or other of the species becoming extinct appears to be negligible, at least in terms of any 
ordinary time scale, once their numbers are in the region of their equilibrium levels. For 
instance, to take the predatory species which has the smaller numbers as an example; the 
order of magnitude of the mean passage time to extinction is likely to be inversely propor- 
tional to the probability of the zero state, or in terms of a normal distribution, using the 
observed mean and variance for this species, of the order of 1-4 x 10" units of time. It 
might be expected, therefore, that this system would continue to oscillate around the 
equilibrium level in an irregular fashion for a comparatively lengthy period. But, in other 
systems, this may not be so, and the chances of extinction may then become appreciable. 

This point is relevant to the results obtained by Gause (1934) in his experiments with the 
two Protozoa, Didinium nasutum and Paramecium caudatum. The latter species is devoured 
by the former, and the amount of food required by Didinium is very great. His first experi- 
ments were carried out in a relatively small microcosm (the upper asymptote in numbers of 
the Paramecia, when living alone, being of the order of 100 individuals), and the introduction 
of small numbers of Didiniuwm at varying intervals of time after the prey was followed by 
an intense multiplication of the predator, which devoured all the prey and afterwards 
themselves perished. There was also a considerable degree of variability in numbers between 
replicates of the same age (Gause, 1934, Chapter VI and Appendix, Table 6), 
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Suppose, then, we have a relatively small environment in which a species of prey is 
established, and which is then invaded by a small group of predators. For simplicity it will 
be assumed in the model that the intrinsic rates of increase and the birth-rates of both 
species are the same, and that in (2-1) we put 


A, =A, = 1-25, 6, =b, = 0-25, a, = 0-001. 
These values of A, and a, lead to a logistic upper-asymptote in numbers of the prey, if it 
were living alone, of 250 individuals. When it is assumed that the birth-rates of both species 
remain constant, the remaining parameters, /, and a, in (1-1) and (2-1), define the magnitude 
of the effect which the numbers of each species have on the death-rate of the other. £, might 
be termed the ‘relative voracity’ of the predator in regard to the prey, since for a given value 
of N,, the greater the value of this parameter, the more the death-rate of the prey is affected 
during a unit of time; and «, represents the sensitivity of the predator to the relative density 
in numbers of the two species, i.e. for a given value of the ratio N,/N,, the greater the value 
of a, the more the death-rate of the predator is affected. Consider three systems in which 


f, and «, are varied slightly, which together with the values of the other parameters given 
above lead to the following stationary states: 


System Ay Oe DT, L, 
(i) 0-015 0-375 22-7 15-2 
(ii) 0-025 0-500 18-5 9-3 
(iii) 0-050 0-250 4-9 4-9 


Some realizations were computed for each of these three systems, taking in each case 
N,(0) = 200, N,(0) = 15 as the initial conditions, i.e. it was assumed that the prey was well 
established in this imaginary environment, when it was invaded by a small group of 
predators. The results were as follows. 

System (i) 

The computations were carried on for 399 steps, at the end of which time neither species 
was eliminated, though at one point the predator was very close to extinction, having been 
reduced to only one individual surviving on two successive occasions. Neglecting the first 
ten steps, during which time an approach was being made tothe region of the stationary state, 
the observed means for the remaining 389 observations were NV, = 25-33 and N, = 12-96; 


while the observed variances and covariance compared with the theoretical expectations 
derived from (3-3) were 


Expected Observed 
var (N,) 10] 137-3 
var (N,) 37-7 33-35 
cov (N,, N2) +19-7 + 22-02 


This very good agreement between the theoretical and observed variances was of interest, 
since in this type of discrete-time stochastic model, the assumption made in applying (2-1) 
that the N,(¢+1) (a = 1, 2), for given N,(t) are distributed normally, might be expected to 
break down in the region of small numbers. The observed distributions of N, and N, are given 
in Appendix Table 2, from which it can be seen that these departed appreciably from the 
normal, there being a pronounced positive skewness in each case. However, with no 
knowledge of the form of distribution which might be expected in such systems when 
numbers are small, it is difficult to know what reliance can be placed on this observed 
bivariate d.stributic 
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System (ii) 

The predator became extinct in each of the five realizations which were computed for 
this system. In one case the prey also vanished at the same time as the predator, and in 
another its numbers were reduced to only one individual. In this region of a stochastic 
logistic process, the probability of random extinction should be roughly of the same order 
of magnitude as that of a simple birth and death process with parameters corresponding to 
the intrinsic rate of increase of the particular species, viz. log A = b—d; so that if only one 
individual is left surviving, the probability that the prey population would in turn become 
extinct, is appreciable in this numerical example, being P(0) ~ d/b = 0-11. In other words, 
the disappearance of the predator before the prey may nct necessarily mean that the latter 
species will be able to persist. 

System (iii) 

Out of 19 realizations with the initial numbers N,(0) = 200, N,(0) = 15, the prey was 
eliminated by the predator in 9 cases, which would result inevitably in the disappearance 
also of the predator. In the remaining 10, the predator became extinct before the prey; but 


90 -- 
80K 
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60K 
50b 
40K 
30 
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Fig. 2. Representative trajectories for System (iii), for which the deterministic stable state is 
L, = L, ~ 5. The initial conditions were for the prey, N,(0) = 200, and for the predator, 
N,(0) = 15, but in order to save space, a few of the initial steps in each realization are omitted 
from the figure. 





in five of these cases the prey at this time was reduced to such low numbers, for example, 
either one or two individuals, that its ability to persist became problematical. There 
appeared to be little difference between the times taken for either predator or prey to become 
extinct, the combined mean passage time to extinction being ¢ = 20-3 + 2-99 units of time. 
The (N,, N,) trajectories differed somewhat, depending on the length of time the interaction 
persisted, but a pair of replicates are illustrated in Fig. 2, for which the passage time to 
zero was of the same order as the mean value. In broad outline the pattern is very similar 
to the trajectories observed by Gause (1934) in his experiments, not only with Didiniwm 
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and Paramecium, but also with other species of Protozoa, for example, Paramecium 
bursaria and Bursaria truncatelia (Gause, 1935). 

The results with these three numerical systems suggest that, in a limited environment, 
in which there is no immigration from outside, the persistence of both species in a predator— 
prey interaction depends very greatly on the relations between the various parameters 
for the two species, and that the chances of random extinction are very sensitive to relatively 
small changes in these parameters. If the magnitudes of the intrinsic rates of increase of 
the two species, the relative ‘voracity’ of the predator, and so forth, are not happily 
adjusted in between themselves, it appears doubtful whether in a very simplified type of 
system both species will be able to persist for very long, and the probability of random 
extinction then becomes a dominant feature of the interaction. 


6. WHEN ONLY A FRACTION OF THE PREY POPULATION IS EXPOSED TO RISK 


In developing the type of model we have used so far, one tacit assumption has been made, 
namely, that in some way or other the entire prey population is exposed to the risk of 
capture by the predator. The background environment in which the interaction takes 
place is assumed to be ina sense ‘homogeneous’, and the predator and prey populations freely 
intermingle. Suppose, however, that this is not so, and that because of some ‘heterogeneity’ 
of the environment, only a fraction of the prey population is exposed to risk during any one 
unit of time. One way in which this might occur would be if the configuration of some type 
of vegetation formed a ‘cover’ for the prey, which protected it from the predator. Thus, 
Gause (1934) has pointed out the importance of a refuge in enabling the prey to survive in 
his experiments with various species of Protozoa, although the predator might still become 
extinct. But, apart from ‘cover’ in its literal sense, a variety of different situations can be 
imagined as regards the environment, or the habits of the two species, which would result 
in the interaction being confined to only a fraction of the total prey population. 

Suppose, for simplicity, that a fraction k (0 < k < 1) of the prey population is exposed 
to risk of capture by the predator, and that this fraction remains constant for a particular 
system. Then, in a more generalized model in the place of (1-1) and (2-1), the deterministic 
part of the process may be written, 


_[P(-ha kA, | 
E{N,(t + 1) | N,(t), N,(t)} as E +a, i) + 1+ a, N,(t) | MO); | (6-1) 
A, N,(¢) 





EXN,(t + 1) | Ny(t), Na} = (%q/ke) {Nq(t)/,(t)}" 


When & = 1, this system reduces to (1-1), and when k& = 0, i.e. when none of the prey 
population are exposed to risk, the predator cannot survive, and the system becomes a 
simple logistic model for the prey population when living alone. 

For the stationary state (L,, L,) of (6-1), we have for the predatory species 


while that of the prey is given by the positive root of the equation, 
fh — = ae > 6-2 


Oy 


where B=a,+ 
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The theoretical variances and covariance of the stochastic model for this type of system 
in the region of the stationary state may be obtained from (3-3), in a similar way to those of 
the original model, allowing for the alterations in the functions f, and f,. 

It is of interest to consider the effect of allowing the value of the constant k to vary in 
a system with a given set of the remaining parameters in (6-1), more particularly in regard 
to the chances of random extinction. As an illustration, take the System (iii) of the previous 


section, for which Ay =A, = 1-25, a, =0-001, f, = 0-050, 


by = by = 0-25, og = 0-250. 


In this case it is known from the realizations already computed that the interaction 
cannot persist for very long, when k = 1. Suppose, now, that & is allowed to vary, and that 
a particular system with constant & is in the region of the stationary state (L,, L,) given by 
(6-2). If, as an approximation, we assume that N,(¢) and N,(t) are both distributed normally 
about means given by this state, then the mean passage time to zero for each speciesshould 
be, very roughly, of the order of magnitude 


©@,(0) ~ J(27)o,e%0a (a = 1,2), 


where the variance 0% is obtained from (3-3). The following are the stationary states (L,, L.) 
and the estimated values of @,(0) for a system with the basic parameters given above, over 
a range of values of k (0 < k < 1). 

Order of magnitude of the mean 











Stationary state passage time to zero in units 
c A Y "eet PS TY 
k Ly Ly ©,(0) ©,(0) 
0 250-0 0 58 x 10% = 
0-05 230-1 11-5 9-8 x 1034 6-2 x 10? 
0-10 194-0 19-4 6-0 x 105 1-3 x 104 
0-15 155-7 23-4 7-4 x 1017 4-8 x 104 
0-20 125-0 25-0 1-2 x 108 6-5 x 104 
0-25 90-7 22-7 1-5 x 108 1-7 x 104 
0-35 50-4 17-6 2-4 x 104 1-5 x 108 
0-50 23-3 11-6 3-3 x 10? 1-6 x 10? 
0-65 12-8 8-3 76 58 
0-80 8-1 6-5 37 34 
1-00 4-9 4-9 20 21 


It will be seen that, as might be expected, the stationary numbers of the prey (L,) 
steadily increase as a smaller fraction of the population is exposed to risk; while those of 
the predator (L,) steadily increase with decreasing k up to a maximum which, in this par- 
ticular example, is reached in the region of k = 0-20. The estimates of ©,(0), which must 
not be taken too literally, change very rapidly as & decreases. Taking the figures for the 
predator, which is the species having the smaller numbers, it appears that the approximate 
maximum mean passage time to extinction is reached at k ~ 0-20, when it is about 3000 
times greater than in the case of the original system with k = 1. These estimates of ©,(0) 
suggest that in this particular system both species would persist for a comparatively long 
time when some 10-35 % of the prey population were exposed to risk, in contrast with the 
relatively rapid extinction of one or other species as this fraction approaches unity. 

It was of interest, experimentally, to see how far some of these figures could be confirmed 
in practice. Taking k = 1 in the model, 100 realizations were computed, starting each time 
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with the initial numbers N,(0) = N,(0) = 5, ie. the nearest integers to the deterministic 
stationary state. In 51 of the replicates the predator disappeared before the prey, the mean 
passage time to the zero state being ¢ = 19-61 + 2-27 units. In the remaining 49 the prey 
became extinct before the predator, with # = 19-25 + 2-55. The distributions of the in- 
dividual times to extinction were very skew, the longest time recorded being in the 
t = 76-79 class.* But these mean figures are in excellent agreement with those given in the 
table above. It is also of interest to note that these mean times may be very little affected 
by the initial numbers adopted in this particular system, as was illustrated in the previous 
section (System iii), when with N,(0) = 200, N,(0) = 15, the combined mean paszage time 
to extinction for 19 replicates was t ~ 20 units. 

When k = 0-8 in this system, the ‘normal’ approximation suggests that the mean 
passage time to zero should be of the order of 35 steps for both species. In 50 realizations 
using this value of k, and taking as the initial state N,(0) = 8, N,(0) = 7, the predator 
became extinct in 38 cases, with ¢ = 43-55 + 6-36; while in the remaining 12, the prey 
disappeared in ¢ = 50-17 + 11-48 steps. Both of these means are somewhat greater than the 
expected figure, but the distributions of the individual times were even more skew than in 
the preceding examples when k = 1, the interaction on one occasion persisting for 172-175 
steps before the predator became extinct. In general, however, these computed mean 
times to extinction for the two values of k are in reasonably good agreement, at least as 
regards orders of magnitude, with those derived from the normal approximation. 

A further realization was computed for the case of k = 0-20, for which, according to the 
above table, the chance of the predator being able to persist is at a maximum, and starting 
with the initial numbers of N,(0) = 125, N,(0) = 25, the calculations were carried on for 
999 steps. During this time there appeared to be no definite approach to the zero state, 
although on one occasion the numbers in the predator population fell to only six individuals. 
The observed means for the 999 observations were N, = 120-75, N, = 22-37, compared 
with the deterministic stationary state of L, = 125, L, = 25; and the variances and co- 
variance were var (N,) = 345-2, var (N,) = 37-66 and cov (N,, N,) = + 8-24. These observed 
variances are in very good agreement with the theoretical approximations derived from 
(3-3), namely o? ~ 296, 02 ~ 37-4 and oy, ~ + 7-53. The grouped frequency distribution of 
N, and N, is given in Appendix Table 3, and from the marginal distributions we have for 
the prey species (Ni) |. _0.168+0-077, g, ~ — 0-089 + 0-156, 
and for the predatory species (N,) 

g, ~ +0:13140-077, g_ ~ — 0-133 + 0-155, 


where the standard errors attached to the estimates are again the classical values, repre- 
senting lower limits to the correct values. The magnitude of the skewness coefficients 
suggests that the distribution can be regarded as approximately bivariate normal in form. 
But, the main point of these results is to confirm that in this system, both species should 
co-exist for comparatively lengthy periods of time when, owing to some ‘heterogeneity’ 
of the environment, the fraction of the prey population exposed to risk is of the order 

* In carrying out these computations, the machine was instructed to stop whenever the number of 
one or other species reached zero, and to record the number of steps taken for this point to be reached. 
Although the means and variances were computed from the individual figures, the frequency distribu- 


tions of the times to extinction were finally printed in groups of four units, so that it is impossible to 
give the exact highest and lowest figure observed. 
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of 20%. Naturally, this optimum fraction, which reduces the chance of random extinction 
of the predator to a minimum, wi!l vary from system to system and may indeed be insufficient 
te prevent the disappearance of one or other species. 

The ‘heterogeneity’ of the environment is not, however, the only factor which would 
tend to increase the probability of both species co-existing. The relative dispersion and 
movements of the two species over an area may also be important. This has been illustrated 
very elegantly by some experiments by Huffaker (1958) with the mite Hotetranychus 
sexmaculatus as the prey, and the predator mite, T'yphlodromus occidentalis, in which a 
number of oranges, arranged in trays in a two-dimensional manifold, were used as the 
medium on which the prey species could develop. In all his simple universes, the inter- 
action did not persist for very long, either the predator or prey disappearing as in Gause’s 
experiments with various species of Protozoa, to which we have referred. But, when in 
Huffaker’s experiments partial barriers were included in his universe, the co-existence of 
the predator and prey was maintained for three successive oscillations of the system. This 
more complex environment, in which the partial barriers restricted the movements of the 
species from orange to orange arranged in a two-dimensional grid, made it less likely that 
the predator would be in contact with the prey at all positions simultaneously. In a stoch- 
astic model for this type of system it would be necessary to incorporate a spatial grid, with 
restricted or partially restricted movements of the individuals from cell to cell, as in the 
model designed by Bartlett (19576) for studying theoretically the development of a measles 
epidemic in a community. In terms of the simplified models used here, the nearest approach 
one could make to such a system would be to consider that the fraction k of the prey popula- 
tion exposed to risk was not a constant, but a variable; although at first sight it is not easy 
to see what form of functional dependence of & on the relative numbers of the two species 
should be adopted in the model. Generally speaking, however, it seems likely from the 
results for constant k given in this section, that even in the case of variable k, provided that 
this variability is not too extreme, the likelihood of both species being able to co-exist would 
be greatly increased. 
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ApPENDIx [ 


For convenience, the bivariate distributions of N, and N, in the region of the stationary state for the 
three systems, to which reference has been made in the text, are given all together in this appendix. 
These grouped frequency distributions were tabulated by hand from the typed lists of results for each 
series, the marginal totals being checked by the distributions of each species (grouped in pairs of integers, 
0—, 2-, 4-, 6-, etc.) recorded by the machine. It should be noted, however, in this connexion that all 
the variances and covariances given in the text were calculated on the machine from the individual 
results in each series, and not from the grouped data. They are therefore, in a sense, exact. The following 
were the values of the parameters used in computing the processes. 


Parameter Table 1 Table 2 Table 3 
XQ 1-2574 1-25 1-25 
b; 0-2577 0-25 0-25 
Oy 0-0005148 0-001 0-001 
Bh, 0-0018018 0-015 0-050 
Ay 1-1892 1-25 1-25 
be 0-2521 0-25 0-25 
Oe 0-2838 0°375 0-25 


k 1-0 1-0 0-20 
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Hierarchical birth and death processes 
I. Theory 


By GUNNAR BLOM 
University of Lund, Sweden 


SUMMARY 


A hierarchical birth and death process is defined by dividing the states of a birth and 
death process into substates according to certain rules. Only processes with constant 
transition probabilities are considered. In § 1, some basic results concerning integer-valued 
Markov processes are reviewed. In §2, a special hierarchical process is discussed, and in 
$3 equilibrium probabilities of the states of this process are derived in terms of given 
transition probabilities. In § 4, brief attention is paid to another special case. In § 5, a more 
general hierarchical process is analysed. 

The processes considered in §§ 2-5 are finite. In § 6, this restriction is removed, so that 
the process is allowed to adopt an infinite denumerable number of states. Sufficient con- 
ditions for this general process to enter into statistical equilibrium are given. 

Some of the results presented in this paper may be obtained from the general theory of 
reversible Markov chains and processes. However, the paper will be self-contained to a 
large extent, and most of the results will be derived from first principles. 


1. SOME BASIC RESULTS CONCERNING INTEGER-VALUED MARKOV PROCESSES 


The hierarchical processes considered in this paper are special cases of a general integer- 
valued Markov process with constant transition probabilities. The number of states of the 
process is assumed to be finite or, more generally, denumerable. For the general theory of 
Markov processes, the reader is referred to Ch. VI of the book by Doob (1953), to several 
publications by Feller (e.g. 1940, 1950, 1957) and to Kendall & Reuter (1957), where refer- 
ences are also given to several other important papers. 

Denote the states of the process by Ep, £,,..., and suppose that the transition L; > E; 
occurs between ¢ and ¢+At with the probability a,;At+o(At) (i +7). Further, define 
ay = — Y Uy. 

vei 

Let P,,(t) be the probability that at time ¢ the process adopts the state H,,. Naturally, 
this probability depends on the initial state of the process at, say, t = 0. We shall say that 
the process enters into equilibrium when t — oo if 

lim P(t)=F,, (m= 0,1,...), 


t>o 
where the limit does not depend on the initial state, and if, in addition, 
EP, =1. 
m=0 
The quantities P,, will be called equilibrium or steady state probabilities. 
15 Biom. 47 
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The process is called irreducible if, with positive probability, any state can be reached 
from any other state. It has been pointed out by Jensen (1954, p. 40), that an irreducible 
process of the kind considered here enters into equilibrium if and only if the mean number 
of steps for recurrence of a state Z,,, is finite for any m, and, moreover, the mean recurrence 
time is also finite for any m. 

This result is essentially a consequence of Feller’s theory of recurrent events. The con- 
ditions can be given another and generally more useful formulation, which is due to Jensen. 

Consider the infinite system of equations in the unknowns 2p, 2, ... 


Lamm =0 (J = 0,1,...), (1) 
THEOREM. An irreducible Markov process with constant transition probabilities enters into 
equilibrium if and only if there exists a solution x,, > 0(m = 0,1, ...) tothe system (1) such that 
oo wo 
the two series S) x,, and ¥ (—Gym)X,, are both convergent. 
m=0 m=0 
In particular, if the number of states is finite, the system is of course also finite and com- 
prises as many unknowns and equations as there are states. The process enters into equi- 
librium if and only if x,, > 0 for all m. 
For a process which satisfies the conditions of the theorem it is, at least in principle, easy 
to determine the equilibrium probabilities. Indeed, P,, is proportional to x,,, which implies 
that the probabilities can be determined from the system 


2 4mi Fm = 0 (j= _§ em 

w (2) 
x ln = 1. 

n= 


m=0 


2. A SPECIAL FINITE HIERARCHICAL PROCESS 


Weshall begin by considering an ordinary birth and death process with a finite number of 
states L,, (m = 0,1,...,n). At any time-point t the process may change from one state to 
neighbouring states according to the following rules: 


E,,, > E,,4, with probability a,,At (m= 0,...,n—1), 

E,, > E,~, with probability b,,At (m = 1,...,n). 
More exactly, this means that, if the system has adopted the state H,, at time ¢, it changes 
during (t,¢+ At) with probability a,, At + o(At) to E,,,,, ete. 

We shall assume that a,, and b,, are positive for any m. The process is then irreducible 
and enters into equilibrium when ¢ —- oo. The equilibrium probabilities P,, are obtained 
from the general system of equations (2), which takes the form 

a Fy = b,P,, 
(4, + bm) Fan = Oma Piya , b, Pras (m =! geen MU — I ). 


De 
ed 6 Gy P 1. 


AyQ,... 


The system has the solution P= wa) Pp. (3) 


m = “bby... 


where P, is determined by observing that the probabilities add up to unity. 


m 











It 
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So far everything is well known. To arrive at the special hierarchical process considered 
in this section, we shall (a) divide the states of the birth »nd death process into certain 
substates, (b) specify what will be called the permissible tes. We shall give a detailed 
description of these two parts of the definition in the remaining part of the section. 

It should be pointed out that the process considered here has mainly theoretical interest, 
but it is of basic importance for the treatment of the more general process introduced in § 5. 


(a) Division of the birth and death process into substates 
E, is left unchanged. £, is divided into N substates LZ; such that 

E, > E,; with probability ajp,;At (i = 1,...,N), 

E, > E, with probability b,q;At (i = 1,...,N). 


To make the system of notations wholly consistent, it would perhaps be better to write 
E instead of Ey, but we prefer to use the usual notation for the null state. 
Furthermore, F, is divided into N? substates E;; such that 


EL, > E,; with probability a,p, At, 
E,; > E; with probability b.q; At. 


It should be observed that the ‘birth’ probability does not depend on i, only on j. 
Generally, E,,, is divided into N™ substates E;; __,, (m indices) such that 


Ei; ...y > Eij... yz With probability a,,_,p,At, 
Eis5...y2 > Hiy...y with probability 6,,q, At. 
With respect to the quantities p, and q, we shall make the following assumption. 


AssumPpTION 1. The quantities p,, ..., Py and qj, ...,dy are positive. 


The number of indices in E;; _,, will be termed the order of the state. 

Note that the total number of substates resulting from the successive divisions is 
1+N+...+N”. However, some of these substates may sometimes be excluded, as will 
appear from the second part of the definition. 


(b) Specification of permissible states 


When the transition probabilities mentioned above are given, the hierarchical process 
would be uniquely defined, were it not for the fact that we shall sometimes restrict the 
process so as to adopt only certain states, which will be called permissible. This means that, 
in the above definition of a transition from a state to a next higher one, we shall allow z to 
range only over a subsequence of the integers 1, ..., V. The subsequence may depend on the 
previous state Z;; ,. Using another terminology, we may say that the p, are sometimes 
put equal to zero. The states which the process cannot adopt will be termed forbidden. 

The process is defined when a complete list of permissible states is given. Such a list may 
take on different shapes depending on the problem under study. However, in order to arrive 
at simple and useful results, we shail make the following rather general assumptions. 


AssuMPTION 2. There is at least one permissible state of cach order. 


AssumPTION 3. If a state E;; , is permissible, then also the states obtained by permuting 
the indices in all possible ways are permissible. 
15-2 
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AssumPTION 4. If a state E;; , is permissible, then also the states obtained by deleting 
any number of indices are permissible. 

Strictly speaking, Assumption 3 is not needed for the analysis of the special process 
considered in this section, but we shall need it later. 

In Part II of the paper, we shall encounter an important example of a situation where 
only certain states are permissible. In fact, we shall then require that those states are 
permissible for which all the indices are distinct. Clearly, the number of permissible states 
is then reduced from the maximum number 


1+N+N?2+...4N" to 14N+N(N-1)+...4+N!. 


When the four sequences {a,}, {b,}, {p,}, {g,} and the permissible states are specified, the 
hierarchical birth and death process is completely defined. We may somewhat loosely 
describe it as follows. If the system starts from the null state Z, and passes successively 
to higher states, it ‘remembers’ all the substates where it has been before. If ‘death’ occurs, 
the system passes to a next lower state which is uniquely defined by the previous state. 
This remark about the ‘memory’ of the process should not give the reader the false impres- 
sion that the process is non-Markovian. In fact, if the substates are renumbered using a 
single sequence of indices, it is recognized that any transition depends only on the last 
state and not on any previous states. Thus the process is Markovian. 


3. STEADY STATE PROBABILITIES OF THE SPECIAL PROCESS 


Consider the special hierarchical birth and death process defined in the preceding section. 
Our main task in this section will be to derive expressions for the steady state probabilities 
of various states H;; ,,.. For this purpose, we could use the system (2) directly. However, 
it is more informative to start from first principles. 

Suppose that the process begins in E, at ¢t = 0, and let P,;_ ,(t) denote the probability 
that at time ¢ it assumes the state H,; .. Let the number of indices in these expressions 
be m. By comparing two adjacent time-points ¢ and ¢ + At, we obtain the relations 


P,; a yall + At) = (1 ai Am =p, ia One) P,; isd yall) x m1 PoP; ads y(t) + Onsa xq, P;; at) 
Denoting by P(t) the probability that the system is in EZ, at time t, we also have the relation 
Ly(t + At) = (1—ayXp,) Po(t) + 6, 2g, P(t). 


In these relations & denotes summation over all vy such that Z;, ,, is a permissible state. 
The first relation holds for any number of indices ij ... yz from 1 tom —1. It also holds when 
this number is equal to n, provided that we put a, = b,,, = 0. 

Note the importance of the assumptions made in § 2 about the choice of permissible states. 
By Assumption 2, there is at least one relation corresponding to any order m. Further- 
more, by Assumption 4, the transitions E;; ,,—> H,;, and L;;_., > E;;,, are always 
possible (if this were not so, one or perhaps several terms would disappear and the equation 
would not hold). 

We now apply the general theory reviewed in §1. It follows from Assumptions 1 and 2 
that the process is irreducible and enters into equilibrium when ¢ > oo. Letting At > 0 in 
the above relations and putting the resulting derivatives equal to zero, we obtain the steady 
state system of equations a, Up, P, = b,Xq,P 


y 


An xp, P;... yz + bn Ve r“.: yz An—1P2F%;... 7] + Dnt xq, Pi; war (4) 











TI 
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The solution of this seemingly complicated system turns out to be very simple. As is readily 
verified by substitution, the solution is obtained by equating the second term in the left 
member of (4) to the first term in the right member, which yields 
Gm—1 P 
Py... ye = — =f ij ...y" 
m qd. 
This recursive formula leads to 
Gg Qy ..-Am—1 PD; --- 
F. sg ee OE eS j--'fzp : 
Pe Reaky Gy * 


2 


(5) 


We conclude from the form of this expression that the steady state probability is the same 
for all permutations of the letters ij ... yz. The factor P, is as yet undetermined. Since the 
probabilities add up to unity, we have 


ee 145% Am—-1 Pi Pz (6) 


| A ee ee, 





with summation over all sequences of 1, 2, ...,m indices ij ... yz corresponding to permissible 
states H;; ,,.. This compact formula may be difficult to interpret, and the reader may 
prefer the alternative formula given below. 

We shall sometimes be interested in considering the totality of all permissible states 
E,;,,.,0fa given order m. We shall denote this ‘super-state’ by &,, (m = 0,1, ...,). Naturally 
&, = E,. The steady state probability corresponding to &,, will be designated by II,,. To 
find II, we have of course only to sum (5) over all permissible states of order m. With a slight 
change of notation we have 


i ee Pa Pap (7) 
by ..-By Gy +> Ins 
with summation over as many sequences of indices 1,, ..., v,, a8 there are permissible states 
of order m. We may then write equation (6) in the alternative form 
= te 1+ > Il 
Py m=0 


We shall end the section by considering a very special case. Let us assume that all states 
are permissible and, moreover, that N 
> Py = l. 


v=1 % 
Then the sum in the right member of (7) becomes (p,/q,)”" = 1, and hence this formula 
reduces to Qy.-.@ 


Consequently, as seen from (3), the probabilities II, are in this special case identical with 
the steady state probabilities P,, of the simple birth and death process which served as our 
starting-point in § 2 when defining the hierarchical process. 


4. ANOTHER SPECIAL HIERARCHICAL PROCESS 


As pointed out earlier, the process considered in the preceding two sections has mainly 
theoretical interest. From a practical point of view a more interesting case arises if the 
transition rules given in § 2 are changed in the following way: 

Ei;...y > Bij... yz With probability a,,_,p, At, 
Ei; ... ye > Ej... yz With probability 6,9; At. 
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Thus, when passing to a lower state, the first index is deleted instead of the last one. In 
all other respects the rules are the same as before. The resulting hierarchical process has 
interesting applications to queueing theory (cf. Part IT). 

By the method used in § 3 it can be proved that the steady state probabilities of the new 
process are given by the same expressions (5) as before, provided that 


1 sid Go =. = Qn: 

However, if the q, are unequal, no such simple solution is generally possible. To prove this 
statement, we proceed as follows. 

Suppose that Assumptions 1-4 hold. By analogy to (4) we have the system of equations 

An xp, Pi;... yz a bn Qi Pj... yz On PeP i; woe er On+1 xq, P, 


ptf ...8° 


It is easy to verify that if the probabilities P satisfy (5), then the first term in the left member 
and the second term in the right member cancel out; hence the system reduces to 


bn GF; 


tj... YZ 


- An 1D; 


ij...y"* 


Inserting the expressions (5) in this relation, we obtain after reduction q; = g,. Consequently, 
if the q, are equal, the system is certainly satisfied by these simple expressions. It also follows 
that if in the list of permissible states Z;; , two of the indices, say i and z, may assume any 
of the N(N —1) pairs of distinct integers (1,2), (1,3), ..., (N—1,), then (5) holds if and 
only if all the q, are equal. 

It may be added that, since (5) holds in this case, this is of course also true of the expres- 
sion (7) for the super-state probability II,,. 


5. THE GENERAL FINITE HIERARCHICAL PROCESS 


We shall now introduce a general process, which contains the two processes discussed in 
the preceding sections as special cases. The division of the original birth and death process 
into substates is made exactly as before; only the transition rules are affected by the 
generalization. 

The transitions of the general process may be schematically described as follows (as 
before, m is the number of indices in E,;_,, and ranges from 0 to n; the indices themselves 
range from 1 to NV): 

Euj.y An_1,1P,At, 
| izj...y? Ano 2p, At, 


eee eee eee ee eee eee eee 


, (8) 


ee ee ee eee ee ee! 


By..0 ‘Saas. 





(The quantities in the right-hand column denote the probabilities corresponding to the 
various transitions.) In short, transitions may occur between states which have all but one 
index in common. Expressed otherwise, a next higher state is obtained by adding one index 
in any position, and a next lower state by deieting one index in any position. 





in 


eq 


ec 
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To avoid ambiguity we shall demonstrate by an example how the rules should be inter- 
preted. Consider transitions from states of order m = 2 to the next lower states. For 
example, the transition E,,-—> HE, takes place with probability b,,¢,At in the interval 
(t,t+At), and H,,—> EH, with probability b..q,At. However, since £,, turns into EZ, by 
deleting either the first or the second index, the transition Z,,-> ZH, occurs with prob- 
ability (b,, + bg) q, At. 

We shall always suppose that the general process satisfies Assumptions 1—4 of § 2 and, 
in addition, the following assumption: 


AssuMPTION 5. The quantities a,,_, ,and b,, (v = 1,...,m; m = 1,...,n) are non-negative. 
For any fixed m, at least one a,,_,, and at least one b,,, is positive. 

A process defined by the transition rules (8) and satisfying Assumptions 1-5 will be called 
a finite hierarchical birth and death process. Any such process is irreducible and enters into 
equilibrium (cf. § 1). 

It will be convenient to introduce the notations 


™m 


an = 2X tm—1,93 a, = 2 Ove (m = 1,...,). (9) 


By Assumption 5, a,,_, and b,, are positive for any m. 

The equilibrium probabilities of the states E,; _,, are determined by the system of linear 
equations 
q Om UPy Pi; yet (Omi Gi + s+ +b. O3Ficws 

= [Qm—1,1Pi Pj... yet ++ + Oy 1 mPol is... y] (10) 
a [Om+1, 1 Xq, Pi: col tee t Ont, m+1 xq, P;; ae: wl 


In each sum the summation should be extended overall permissible states. By Assumptions 3 
and 4, each sum ranges over the same subsequence of the integers 1,...,N. For m = 0 
and m = n, the system should be modified in the usual way; for brevity we do not reproduce 
these equations. 

In the general case the solution of the system (10) is complicated and will not be repro- 
duced here. However, it sometimes turns out to be quite simple. In particular, we are 
interested in finding out under what conditions the solution is furnished by the simple 
expressions (5) encountered in the previous sections. For this purpose, we simply sub- 
stitute these expressions in the system. It is seen that the first term in the left member 
and the sum within the second pair of brackets then cancel out, and after some reduction 
the following condition for the validity of (5) is obtained 





Am—1,1 01 +... +An-1,m I ot Am—1 


. 11 
OmiGt owe +O, Qe Din ( ) 


This condition is satisfied in two main cases. The corresponding processes will be termed 
hierarchical processes of Type A and B, as described below. 
DerFIniTion 1. If Assumptions 1-5 hold and if, in addition, 


n= G+ = IN) (12) 


then the hierarchical process is said to be of Type A. 
The condition (11) is evidently fulfilled in this case. 
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DerIniTion 2. If Assumptions 1-5 hold and tf, in addition, the quantities a,,_, , and b 
are proportional for any fixed m, i.e. 


mv 


Ant,» =Cm0m (Cm > 9; v = 1,...,m), (13) 
then the hierarchical process is said to be of Type B. 

(Note that (13) implies that if a,,_,, is zero, then also 6,,, is zero, and vice versa.) Also 
in this case condition (11) is satisfied. 

We infer from these considerations that the steady state probabilities of hierarchical 
processes of Type A and B are given by the expressions (5). As a consequence, also the 
expressions (7) for the steady state probabilities of the super-states II,, are valid for these 
processes. These results greatly facilitate the study of Type A and Type B processes. 

In § 4 we have already seen an example of a hierarchical process of Type A. The special 
process discussed in §§ 2 and 3 is obtained by taking @,,_1, = Gn_1, Umm = 6», and equating 
the other a,,_,, and 6,,,, to zero. Hence this process is of Type B. Further examples will be 
presented in Part II of the paper. 

It might be added that certain of the results proved in this section are closely connected 
with the theory of reversible Markov chains and processes put forward by Kolmogorov 
(1936), Kendall (1958) and Kramer (1959). A reader familiar with this theory will find that 
a hierarchical process of Type B (but not Type A) is reversible. 


6. THE GENERAL INFINITE HIERARCHICAL PROCESS 


The processes introduced in the foregoing section have a finite number of states. We shall 
now remove this restriction. It will be supposed that the number n of states of the original 
birth and death process may be infinite. As before, the states Z,,, (m = 0,1, ...) are divided 
into a finite number N™ of substates. Also in other respects the definitions are the same as 
before, i.e. the transitions take place in accordance with the scheme (8), and Assumptions 
1—5 are supposed to hold. The resulting process will be called an infinite hierarchical birth 
and death process. The classification into Type A and Type B processes is extended also 
to the infinite case (cf. § 5). 

As before, there are two problems of interest. First, does an infinite process enter into 
equilibrium when t > 00? Secondly, what are the equilibrium probabilities? 

The second question is easily answered. Provided that the first question is answered in 
the positive, it is realized that the equilibrium probabilities satisfy the system (10), which is 
now infinite. In particular, if the conditions (12) or (13) are fulfilled, the solution (5) is 
obtained. It remains to discuss the first question. 

The behaviour of the process when ¢ + oo is determined by the properties of the two double 
infinite sequences {a,,_, ,} and {b,,,} (v = 1,...,m; m = 1,2,...,ad inf.). A sufficient set of 
conditions for the process to enter into equilibrium may be obtained from the theorem of 
§ 1 in the following way. 

Consider the infinite system of equations (cf. the system (10)) 


Am UP, Wis... yet (Omri t «++ + Omm Qe) Vis... v2 
= [@n—11 Pi UG... yo t +++ + Om—1 mP 2 Vij... y] 
+ [Pint 2 Oy Uyig gt +++ + Omir ms 2G Vij... 01: (14) 
Note that for m = 0 the system is simplified to 


x cin 
Ay =P, Uy = by 2q,u,. 








} 
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| 
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In each sum, the letter v ranges over the subsequence of 1,...,N corresponding to the 
permissible states. 


THEOREM 1. Consider an infinite hierarchical birth and death process which satisfies 
Assumptions 1-5. The process enters into equilibrium when t > 00 if there exists a solution 
Ui; ...yz > 0 of the system (14) such that 


% Ue < 0, (15) 
E (an + bn) Un < ©, (16) 


where U,, 18 the sum of all u;; 4, corresponding to permissible states of order m, and a 
are defined by (9). 


and b 


m m 


Proof. It follows from the theorem of § 1 that the process enters into equilibrium if and 
only if 
Liz ys < @, 


X(a, Zp, + Oni Gi +... + Dinm Te) Vij yz <0 


with summation over all permissible states. The first condition is identical with (15). With 
respect to the second series, we observe that since the number of quantities p, and q, is 
finite, a quantity C can be found such that the factor within the parentheses is less than 
C(a,,+,,). Consequently, the second series certainly converges if (16) holds. This proves 
the theorem. 

In the particular case when the process is of Type A or B, a more convenient sufficient 
set of conditions is given by 


THEOREM 2. Consider an infinite hierarchical birth and death process of Type A or B. 
Let a,, and b,, be defined by (9) and set 


N 
> a, 
v=1 9, 
© Ay... 
If > a He<a (17) 
m=1 by... m 
nd ~ b Uy «++ Up m , 18 
a a (a, + * b b cn < ®, ( ) 
m=1 poss ee 


then the process enters into equilibrium when t > o. 


Proof. Condition (15) becomes in this case 


sec) 211 m-1 Pi ---Pz <0 
6, ...%, Qh... 


with summation over all permissible states. This condition certainly holds if the series 
obtained by summing the same expression over all states (permissible and forbidden) is 
convergent, i.e. if (17) holds. Similarly, it follows that condition (16) holds if condition (18) 
is fulfilled. This proves the theorem. 
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Hierarchical birth and death processes 
II. Applications 


By GUNNAR BLOM 
University of Lund, Sweden 


SUMMARY 


In Part I of this paper (pp. 235-44), the theory of hierarchical birth and death processes 
was expounded. In the present part, two kinds of applications will be given, namely, to 
machine interference and telephone trunking problems. 

In §1, a review is given of the well-known queueing problem arising when a group of 
identical machines is serviced by one operator. Stoppages are assumed to follow the simple 
Poisson scheme, and the service-time distribution is supposed to be exponential. In § 2, 
an analysis is made of the corresponding problem for machines with different needs of 
service but the same service-time distribution. This problem does not seem to have been 
discussed before in the literature. In §3, the result is generalized to the case of several 
operators. 

Palm (1937) determined the equilibrium probabilities of the states of a busy-signal 
telephone system used by a finite number of subscribers with different call frequencies. It 


is shown in § 4 that this problem can be solved by means of the theory of hierarchical birth 
and death processes. 


1. SERVICING OF MACHINES WITH THE SAME NEED OF SERVICE 


For later purposes we shall sum up some properties of a well-known queueing process 
considered by Palm (1947) and later by Feller (1950, chap. 17.7), and several other writers. 

Let n machines be serviced by one operator and suppose that the machines behave in the 
same way as follows. If a machine is working at time ¢t, the probability is A At + o(At) that 
it stops before ¢+ At. Also, if it is being serviced at time ¢, the probability is ~ At +o(At) 
that service ends before ¢ + At. The machines are attended to in the order they stop. 

The resulting queueing process is of the simple birth and death type mentioned at the 
beginning of § 2 of Part I. Denote by P,, the steady state probability of the event ‘m machines 
are being serviced or are waiting for service’. To determine P,, we may use formula (3) in 
the section just mentioned with 


a, =(n—m)A; b, =p. 


This leads to P,, = n(n—1)...(n—m+1)p™P,y (m=1,...,n), (1) 
A 
where p= n 
is the servicing factor. Moreover 
RJ =1+ D n(n—1)...(n—m+1)p™. 
Py m=1 


Clearly, P, is the fraction of time during which the operator is free. We shall also be interested 
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in determining the fractions of time S, M and W during which a certain machine is being 
serviced, is in working state, or is waiting for service, respectively. We have 


12 es 

ade! as lr we 

ee » (n—m) P,,, | (2) 
N m= 

W =1-S-M. 


For numerical purposes it is convenient to use the following formula for the machine 
efficiency M, viz. 1—P, 

a? 
However, in the sequel we shall be more interested in a somewhat different expression 
(cf. Benson & Cox (1951), p. 70). Let us write P(x) instead of P, in order to emphasize that 
it signifies the event ‘operator in charge of n machines is free’. Since by (1) 


E (n—m) Py = nf. 4" (n—1)(n—2)... (n—m) | Pn) 


m=0 m=1 


si P,(n) 
“93, - 1’ 
we obtain from (2) M= Peay (3) 
»(n — 


Thus the machine efficiency can be expressed as the quotient between P,(n) and the prob- 
ability P,(n — 1) that an operator attending n — 1 machines is free. 

It is instructive to examine a little more closely what this means. For this purpose, set 
P,(n) = MP*. By the definition of conditional probability, P* is the conditional probability 
that, when it is known that one machine is in working state, also all the others are working. 
The relation just proved states that P* = P,(n — 1); hence intuition does not lead us astray 
if, during the fraction of time when a certain machine is running, we disregard this machine 
and consider the remaining — 1 machines as a closed system. It should be observed that 
when the process is non-Markovian, this reasoning is generally not correct. 


2. SERVICING OF MACHINES WITH DIFFERENT NEEDS OF SERVICE. ONE OPERATOR 


It sometimes happens that, of a group of machines, some require more attention than 
others. For example, in the textile industry it is, at least in Europe, common practice that 
different types of cloth are woven on the looms attended by the same weaver. Some machines 
may then stop more frequently than others, for example, because the end-breakage rates 
depend on the count of the yarn, the design of the fabric, etc., and hence tend to be different 
in the long run for different cloths. Also the average time required for attending to a loom 
when a stop occurs may depend upon the cloth woven; however, this dependence is gener- 
ally insignificant, and we shall disregard it altogether in this section; i.e. we shall suppose 
that the service-time distribution is the same for all the machines in the group. 

We make then the following assumptions. The group consists of n machines. The prob- 
ability is A,At+o(At) that the vth machine calls for service between ¢ and t+ At. Also, if 
a machine is being attended to, the probability is ~At+o(At) that service ends between 
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t and t + At. We wish to calculate the fraction of time P, when the operator is free, and also 
the fractions of time S,, M, and W, when the rth machine is being attended to, is in working 
state, and is waiting for service, respectively.* 

The solution to the problem is readily obtained from the general theory of Part I. Denote 
by E;;__, the event ‘the ith machine is being attended to, and the jth, ..., zth machines are 
queueing for service in this order’, and by @,, the event ‘m machines are not working’. 
The corresponding equilibrium probabilities are denoted by P,;_, and II,,, respectively. 
Clearly, the indices 7 ...z are always distinct, and hence the total number of permissible 
states equals 1+”+n(n—1)+...+n!. The following transitions are possible: 


Ej; > Ei... y, with probability A, At, 
Eis; ye > yj... yz With probability At. 


Further, Assumptions 1—4 (cf. § 2 of Part I) are fulfilled, and we note that the process is of 
the special type described in § 4 of Part I. In fact, in the scheme given in that section we 
may take N = n and 


a€,.,=b,=1 (m= 1....,n); p,=A, G]@=H2 (v=l.,...,2). 


By the terminology introduced in § 5 of Part I, the queueing process is a hierarchical birth 
and death process of Type A. 
By the basic formula (5) in Part I, the steady state probabilities are given by 


Pij_..2 = PiP; +++ P2Po (4) 
A, 
where p, = le 


is the servicing factor of the vth machine. 
Next we shall write down an expression for the probability [1,, that m machines are not 
working. By formula (7) in Part I 


In = LPP; -+- Pz = Mm! Xpj Ps --- PmLo, 


where the sign & in the latter expression denotes summation of the ( a terms obtained by 


choosing m indices at a time from the sequence 1, ...,n. Furthermore, by adding the prob- 
abilities II,, we find 
1 7 - 
p a 1+ 2p +2! Upipet... +0! Py --- Pn: (5) 
0 


The fraction of time S, when the vth machine is attended to is obtained by adding all 
P,;..., With first index i = v. Hence by (4) 


S, = p,(1+X'p,+2!X'p, pot...) B, 


where &’ denotes summation over all indices 1, ...,2 except v. 
Similarly, the fraction of time M, when the vth machine is doing productive work, i.e. its 
machine efficiency, is obtained by adding over all sequences 7) ... z which do not contain v. 


* As in §1 we suppose that the machines are attended in the order in which they stop. This 
assumption is now rather special; usually it is more economical to give priority to machines with 
small A,. 
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Hence M, = (1+ 2'p, + 2!2'p,p.+...) PB, (6) 
where >’ has the same meaning as before. Comparing the last two expressions, we find 

S, = p,M,. (7) 
Moreover, using (5) we obtain the following generalization of (3) 


P,(1, ...,%) 
eda)” ORES Wee WE | (8) 
This relation reveals an interesting fact, viz. that the comments made in the last paragraph 
of § 1 are valid even in this more general situation. 

It is now clear how calculations should be made in practice. The quantities p, may be 
supposed to be known in advance from time study, analysis of production figures, or the 
like. From (5) we calculate P, for the whole group of n machines and also for the n groups of 
n—1 machines obtained by deleting one value v at a time. Thus n+1 such values are 
obtained in all. Next, the machine efficiencies are calculated by means of (8) for each 
machine, and then S, is obtained from (7). As a check on the computations, one may use 
the relation 8, = 1—Pi1,...,n), 
which expresses the obvious fact that the sum of the fractions of time when the machines 
are attended to equals the probability that at least one machine is not working. Finally, 
since S,+M,+W, = 1, the waiting-times W, can be determined, and the problem is com- 
pletely solved. 

There are some general conclusions which may be drawn from these results. First, it 
follows from (5) that, if the p, are given all possible values such that Xp, is constant, the 
fraction of time P, when the operator is free becomes smallest when the p, are equal. Con- 
sequently, from the operator’s point of view, the latter situation is the most unfavourable 
one. 

Secondly, if the p, vary such that P, is held constant, the average machine efficiency M 
is smallest when the p, are equal. For by (6) we have after some reduction 


a 1 2 
M= B|1+(1 -5) Eat (1-5) 2! Sept... 


It can be proved that when P, and hence the expression in the right member of (5) is held 
constant, M has a minimum for constant p,. This result has perhaps some practical relevance 
in the case where there are several possibilities for assigning machines to a worker, and it is 
required to find a combination which, given a suitable work load 1— P,, makes total pro- 
duction as large as possible. Evidently, our result implies that machines with the same or 
nearly the same p, should not be combined into a group. This remark gives rise to many 
interesting questions, which are outside the scope of this paper. 


3. SERVICING OF MACHINES WITH DIFFERENT NEEDS OF SERVICE. SEVERAL OPERATORS 


The solution of the one-operator problem considered in the previous section will now be 
generalized to the case of several operators. Suppose that the group of m machines is 
serviced by r > | operators. In all other respects the conditions are the same as before, 
i.e. the probability is A, At + o(At) that the pth machine stops between ¢ and ¢+ Af, and the 
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probability is «At +o(At) that a machine which is being serviced returns to working state 
between ¢ and ¢ + At. 

Denote by E;; __, the state ‘the ith, jth, ..., zth machines have stopped in this order and 
are being serviced or are waiting for service’. (Note that this statement does not necessarily 
imply that the machines stopped in immediate succession; it may well happen that one or 
several machines stopped, for example, after the ith and before the jth one and that service 
of these machines has already finished.) 

It is easy to verify that the transitions from one state to the other obey the rules of the 
general hierarchical process considered in § 5 of Part I. First, a transition to a next higher 
state occurs when a machine stops; evidently we have E;; > E;;..4, with probability 
A, At. Accordingly, in the first part of the scheme (8) given in that section we take 


0 for l<v<m-l, 
Py = A,; amn—-1y = { : 
1 for v=m. 

Secondly, when the process passes to a lower state, there are two possibilities: If the 
number of indices m in Z;; _, is less than or equal to r, all the inactive machines are cared 
for at the same time; hence a transition is possible to any of the m lower states obtained by 
deleting one index at a time. On the other hand, if m is greater than r, only the r machines 
which stopped first are being attended to; consequently, only the indices in the first r 
positions may then be deleted when passing to a next lower state. Accordingly, in the 
second part of the scheme (8) we take 


a ? for l<v<vr, 
ee ee te wee, 
Moreover, it is seen that Assumptions 1—5 (ef. §§ 2 and 5 of Part I) are fulfilled in this case. 
Like the process studied in the preceding section, this hierarchical process is of Type 4. 
Using formula (9) in Part I, we conclude that the equilibrium probabilities P,; . are 
obtained by inserting the following values in the formula (5) of Part I 


a,,=1; b,= 


m for m<r, 
m 


} Py =As % = b. 
r for m>r, 

When the steady state probabilities have been determined by the above procedure, 
expressions may be derived for the fractions of time during which the different machines 
are being serviced, are in working state, etc. In this way generalizations are obtained of 
the formulae derived in the previous section. 


4. SOME REMARKS ON INHOMOGENEOUS TELEPHONE TRAFFIC 


Palm has written a paper (1937), which has some connexion with the present work. In 
the last section of the paper, the following telephone trunking problem is considered. A group 
of n channels is used by N subscribers. Each subscriber has full availability to each channel. 
The arrangement is supposed to be a busy-signal one, i.e. if all channels are engaged, the 
subscriber does not wait in a queue, but may make another attempt later on. The traffic 
is inhomogeneous, i.e. some subscribers use their telephones more frequently than others. 
It is required to determine the equilibrium probabilities of various states, for example, of 
the state that all channels are used at the same time. 
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When solving this problem, Palm used the following assumptions (the notation is ours): 

(1) The probability is A,A¢+o(At) that the vth subscriber makes an attempt between 
t and t+ At. 

(2) The duration of the call of the rth subscriber follows the mixed-exponential dis- 
tribution, i.e. the probability of a duration less than a positive quantity ¢ is 


1- c,,e-hrl, (9) 
r=1 
where k, is an integer, the quantities ~, are positive and 3 c,, = 1. Note that the mean 
duration is equal to 1/,, where , “ si 
- 5% (10) 


My = My, 


The purpose of this section is to demonstrate that, in our terminology, Palm studied a 
hierarchical birth and death process and that his results may be obtained by means of the 
theory developed in Part I. To see this, we proceed in two steps and begin with a somewhat 
simpler problem. 


(a) Duration of call follows the exponential distribution 


We then have the following situation. There are N subscribers and n channels (N > n). 
The probability is A,At+o(At) that the vth subscriber makes an attempt between ¢ and 
t+At. Moreover, if a call from this subscriber is going on at time ¢t, the probability is 
1, At + o(At) that it ends between ¢ and ¢ + At. 

Note that this problem is related to the machine interference problem discussed in § 2 
of this paper. Indeed, machines correspond to subscribers, and operators to channels. 
There are, however, two important differences. First, no queues build up in the present case. 
Secondly, the probability ju, is allowed to depend on v, which was not the case in the queueing 
problem. 

To solve this problem, it will be convenient to assign numbers 1, ...,n to the channels in 
any order and to suppose that, when a call is to begin, a free channel is chosen at random. 
Denote by H;; _, the state ‘the ith, jth, ..., zth subscribers are engaged by calls’ and by 

v;;...¢ the substate ‘the ith, jth, ..., zth subscribers are engaged by calls and are using 
channels with numbers in ascending order’. If P;;_,and P;;__, are the corresponding steady 
state probabilities, it is concluded that 


Pig =m! Pig (11) 


The reason why the states Hi; , are introduced is that transitions between these states 
follow the scheme (8) of the hierarchical process defined in § 5 of Part I. It is realized that 
we should take in this scheme 

1 


An ee i (v= | Re) b 


m my — ! (v= 1,...,m); Pp, = A,; qY = 4. 


It is also seen that the process satisfies Assumptions 1-5 (ef. §§ 2 and 5 of Part I) and is of 
Type B. By formula (9) of Part I we have a,,_, = 1, b,, = m, and it is inferred from formula 
(5) of Part I that 
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Using (11) and the notation A, 
y= 
art 
we find the simple result Ps... =PiP; +++ P2Po, (12) 
1 
where =~ 1+ 2p, + Zp, pet... +ZpPyPo--- Py: (13) 
0 


The summation in the last term should be made over the (7) terms obtained by taking 


n indices at a time from the sequence 1, ..., N (and correspondingly for the other terms). 

This solution should be compared to the solution (4) and (5) of the machine interference 
problem in § 2. 

(b) Duration of call follows the mixed exponential distribution 

If the duration of a call is distributed according to (9), the following artifice is used. 
Replace the vth subscriber by a group of k, ‘sub-subscribers’, which are designated by 
numbers p, (7 = 1, ...,k,). The probability that the v,th sub-subscriber begins a call between 
t and ¢+ At is A, At+o(At), where i a 


and the probability that a call from this sub-subscriber ends between ¢ and ¢+ At is 
H,,¢ +0(At). We also suppose that the sub-subscribers in a group use the same line; i.e. only 
one of them can use the telephone at a specific moment. It is not difficult to see that these 
assumptions are entirely equivalent to those used by Palm and quoted at the beginning of 
this section. 

The steady state probability of the event ‘the i,th, j,th, ..., z,th sub-subscribers are 
engaged by calls’ is obtained by taking in the expression (12) the particular values i = 2,, 
J = Joy ++) % = %}; Le. we find 


c 


vy? 


Fe pysilks = Pi,Pi, ++ Pz £o- (14) 


Adding over all sub-subscribers in the ith, jth, ..., zth groups, we have the simple result 


Pj. = Pi Pj ++ Polos 


ky kv ¢ 
where = TP, =a, y 
r=1 r=1 fl, 
: ml 
or by (10) more simply pP, = ri 


As a consequence, formula (12) holds good not only when the duration is exponentially 
distributed but, more generally, when it is distributed according to the mixed exponential 
distribution. This remarkable result is due to Palm. It would be interesting to know if the 
same result is valid for more general distributions; however, this seems to be anopen 
question. 
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A comparison of the effectiveness of tournaments* 
By W. A. GLENN 


Virginia Polytechnic Institute 


1. INTRODUCTION AND SUMMARY 


When it is desired to compare ¢ treatments in a paired-comparison experiment the 
simplest balanced design requires (t—1) units of each treatment. Each replication, com- 
prising $¢(¢— 1) comparisons, is analogous to a round robin tournament involving ¢ players, 
with each comparison corresponding to a game between two contestants. This analogy was 
first pointed out by Kendall (1955). If we are primarily concerned with picking the best 
treatment it may be practicable to use a technique requiring less than (¢— 1) units of each 
treatment per replication. The knock-out tournament (or cup-tie procedure) has been 
suggested for this purpose by Maurice (1958) and a.» by David (1959). Maurice compares 
the balanced design or round robin tournament with the cup-tie procedure for the case of 
four populations with means in the most unfavourable configuration (one population has 
a mean larger by d than the common mean of the other three populations). She bases the 
comparison on the amount of replication (and hence the sampling cost) required to ensure 
detection of the difference d with probability at least P, and concludes that the cup-tie 
procedure is the more economical. In effecting comparisons with the balanced design she 
uses tables provided by Bechhofer (1954). David investigates some properties of knock-out 
and round robin tournaments and obtains an expression for the probability with which the 
best player wins a knock-out tournament, certain assumptions having been made about 
the strengths of the players. 

In this paper six tournament types are investigated for their effectiveness in selecting 
the best one of four players. The types, together with abbreviations used for convenience in 
referring to them, are as follows: R = round robin tournament, Ky = single knock-out 
tournament with a random draw and each pair playing one game, K, = single knock-out 
tournament with a random draw and each pair playing until one of the players has won 
two games, K, = combination of two knock-out tournaments with separate random draws, 
K, = combination of two knock-out tournaments with seeding in the second draw based 
on the outcome of the first tournament, and D = double elimination tournament, in which 
no player is eliminated until he has lost two games. The K, type requires only three games, 
whereas the other types each require a minimum of six games. 

Representing the four players by C,, C,, C; and C,, we write 7,; for the probability with 
which C; defeats C;. We assume that every game results in the selection of a winner, so that 


In § 2 we describe the tournament types and discuss the evaluation of the probability that 
a specified player emerges as winner, after a play-off if necessary, in each type. Without loss 


of generality we take C, as the specified player. The evaluation of the expected number of 
games in each type is discussed in § 3. In § 4 a best player is defined and certain assumptions 


* Research supported, in part, by the Office of Ordnance Research, U.S. Army. 
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are made regarding the parameters 7;;. Two criteria are used for the comparison of the 
effectiveness of the tournament types, viz. (a) the probability that the best player wins, 
and (b) the expected number of games. Comparisons are based on three series of assigned 
parameter values. The special case in which all but one of the players are of equal strength 
(counterpart of the most unfavourable configuration discussed by Maurice) is considered 
in § 5. 

The comparisons in §§ 4 and 5 indicate that if sufficient emphasis is placed on criterion 
(a), K, is the best of the six procedures. Otherwise Ky is preferable. This conclusion is in 
general agreement with that obtained by Maurice. 


2. EVALUATION OF THE PROBABILITY THAT C, WINS 
2-1. Round robin tournament 


In the round robin tournament every player meets every other player once. For four 
players this yields 64 possible outcomes which may be classified in terms of the partitions 


[3210], [313], [230], [2212], 
occurring respectively in the following numbers of different ways: 
24, 8, 8, 24. 


The notation [3210] is used to indicate that one player has won three games, another two, 
a third one, and the fourth none. The other partitions are similarly defined. Outcomes 
related to the players in specified order will be enclosed in parentheses. Thus (3210) will 
represent the outcome in which C, has won three games, C, has won two games, and so on. 

In evaluating the probability that C, emerges as winner, one must consider, in addition 
to the probability of an outright win, the probabilities that C, ties with one or two other 
players and wins the resulting play-off. The probability that C, wins outright is readily seen 
from the outcomes (3210) and (31°) to be given by 74277437744. 

The outcomes in which C, ties with two other players are (2220), (2202), and (2022). In 
writing down the associated probabilities it is helpful to note that the player with no wins 
has lost to each of the others, while the latter have each won once in games among them- 
selves. Thus, for example, we have 


P(2220) = 144747 gq(7127 23731 + 7713721 M39): 


The play-off for outcomes in this category takes the form of a round robin tournament 
with three players, with the possible outcomes [210] and [1°]. If [1*] occurs the play-off 
must be repeated. Thus the probability that a given player wins the play-off is conditional 
upon the non-occurrence of [1°]. For example, the probability that C, wins a play-off with 
C, and C; may be written as 


a 
Pyo3 = 42713] (7 12713 + M21 M23 + 131 M39): 


The complete probability that C, ties with two other players and wins the resulting play-off 
is evaluated from the expression 


P(2220) Prog + P(2202) Prog + P(2022) P54. 


Each of the outcomes (2211), (2121), and (2112), in which C, ties with one other player, 
may occur in four ways, the respective probabilities of which are easily written down. The 
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complete probability that C, ties with one other player and wins the resulting play-off is 
evaluated from the expression 


P(2211) m3 +-P(2121) m3 + P(2112) m4. 


2-2. Single knock-out tournament (K, type) 

We designate by K, the single knock-out tournament involving four players and con- 
sisting of three games, or two rounds of play. For the first round the players are selected 
into pairs at random. The two winners in the first round play off in the second, so that the 
final winner will have won two games, another player will have won one, and the other two 
none. The draw, or selection of the pairs for the first round, may be made in three ways, each 
of which leads to eight possible outcomes, or 24 outcomes in all. Each of these is the par- 
tition [2107]. There are 12 possible outcomes associated with players in specified order, 
each of which may occur in two ways, i.e. in two out of the three possible draws. Since the 
three draws are equally likely, the probability (before the draw) that C; wins two games and 
C; wins one in the K, tournament is given by the general relation 


Tij(M kT jm + Mim jx)/8, 


where C,, and C,, are the two players with no wins. The probabilities of the 12 outcomes are 
evaluated from this relation by assigning all possible ordered pairs obtainable from the 
numbers 1, 2, 3 and 4 to the ordered pair (i, j), and in each case letting k and m be the two 
numbers not in the pair. 


2-3. Single knock-out tournament (K, type) 


One way of introducing replication into a single knock-out tournament is to have each pair 
play more than one game before going on to the next round. We designate by K, the single 
knock-out tournament in which each pair plays until one of the players has won two games 
(a ‘best two out of a possible three’ criterion). K, is effectively the simple tournament with 
three games played in each contest, the third being unnecessary when the outcome is deter- 
mined by the first two. By specifying an odd number of games one takes care of the problem 
of ties in the individual contests. 

The probability that C, wins two out of a possible three games with C; is readily seen to 
be given by Qi; = 73,(1 +21). 
The probabilities associated with the various outcomes in the K, tournament are evaluated 
by following the procedure described in § 2-2 except that all 7,;, 7, 7 = 1, 2,3, 4 arereplaced 
by the corresponding Q,;. 


2-4. Combination of two knock-out tournaments (K, type) 


Replication may also be introduced by repeating the entire tournament, the winner 
being declared as the player with the largest total number of wins, possibly after a play-off. 
The simplest way of repeating the knock-out tournament is to start with a fresh random draw 
for each repetition. We designate by K, the combination of two knock-out tournaments 
based on separate random draws. The two tournaments are evidently independent events. 
The outcomes of the combination may be classified in terms of the partitions [4207], [4170], 
[3210], [3207], [2212], [230], the first three of which correspond to an outright win for one of 
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the players, while the next two represent ties involving two players, and the last one 
represents a tie involving three players. 

The probabilities associated with the various outcomes may be written by appropriately 
associating the expressions related to the single tournament described in § 2-2. Play-offs 
for the ties involving two and three players are, of course, the same as those described 
in § 2-1. 

. 2-5. Combination of two knock-out tournaments (Kz type) 

Instead of using separate random draws, if the tournaments are played in succession, 
one may use the outcome of the first in setting up the draw for the second. At the end of the 
first tournament some evidence has been provided as to the relative strengths of the players. 
The two who have won games appear to be stronger than the two with no wins. We wish to 
investigate the possibility that this information may be used to improve the effectiveness 
of the combination of two tournaments. 

In the K, type we select the draw for the second tournament so that the two players with 
wins in the first tournament remain in opposite halves while the positions of their op- 
ponent einterchanged. The first tournament is based on a random draw, and its outcome 
together with the particular draw used uniquely determine the draw for the second tourna- 
ment. We wish to keep the two players who have appeared best in the first tournament 
apart in the first round of the second. Only two of the three possible draws will accomplish 
this, and the arrangement which we have proposed selects the one of these which was not 
used in the first tournament. Thus the only alternative seeding arrangement would involve 
repeating the first draw. Further reference to this point will be made in § 4. 

The possible outcomes of the K, combination are the same as those of K,, but the tourna- 
ments are not independent events. The conditional probabilities involved are obtained by 
appropriate association of the probabilities of the outcomes of the K, tournament together 
with the draws from which they arise. 


2-6. Double elimination tournament 


In the double elimination tournament no player is eliminated until he has lost two games. 
The first round is the same as for the single knock-out tournament (KK), but in the second 
round, in addition to the two winners, the two losers are entered in play. Of these, one will 
be a two-time loser at the end of the second round, and is then eliminated from further play. 
This leaves one two-time winner and two with a win and a loss, which we shall designate 
respectively by WW, WL, and LW, letting W stand for a win and L for a loss. In the fifth 
game WL and LW play off for the elimination of the loser. The winner, either WLW or 
LWW, meets WW in the sixth game. Should WW win, his opponent is eliminated and the 
tournament ends, the winner being represented by WWW. However, should WW lose, this 
being his first loss, he then has the record W WL whereas his opponent in the sixth game now 
has the record WLW W or LWW W as the case may be. A seventh game is then required to 
determine the final winner, represented by WWLW, WLWWW, or LWWWW as the 
case may be. 

The probability that C, wins is the sum of the probabilities that he achieves one of the 
winning putcomes WWW, WWLW, WLWWW, or LWWWW. This is easily evaluated 
for a given draw and the result for each of the other two possible draws may be inferred by 
appropriate interchanges of subscripts. For the random draw the resulting values are 
averaged over the three possible draws. 
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3. EVALUATION OF THE EXPECTED NUMBER OF GAMES 
3-1. Round robin tournament 


The round robin tournament with four players ends in six games only if one player 
achieves an outright win. Play-offs involving three players require initially three additional 
games, three more if [1°] occurs, and so on, leading to an infinite geometric progression with 
common ratio P(1°). Thus, for example, the expected number of additional games in a 
play-off involving C,, C,, and C, may be written as 


Eyog = 3/ (712713 + M21 M23 + 131 M32): 


The expected number of additional games due to ties involving three players is evaluated 
from the expression 


P(2220) E43 + P(2202) E94 + P(2022) Eyg, + P(0222) Eggs. 


Each of the outcomes in the classification [2717] leads to a single-game play-off. Thus the 
expected number of additional games due to ties involving two players is the sum of the 
probabilities of the outcomes (2211), (2121), (2112), (1221), (1212), and (1122). 


3:2. Single knock-out tournaments (Ky and K, types) 


The K, tournament will always consist of three games, since no tie-breaking play-offs 
are required. However, the K, type requires a minimum of six games, since at least two are 
needed in each of the three contests. A third game is required whenever one player wins the 
first game and the other the second. Thus in a given contest the probability of a third game 
is the probability that a given player wins the first game and loses the second, or vice-versa. 
For a given draw the excess over six ot the expected number of games is the sum of the pro- 
babilities of third games in all contests evaluated for all possible outcomes. For the random 
draw these values are averaged over the three possible draws. 


3-3. Combinations of two knock-out tournaments (K, and K, types) 


In the combinations of two knock-out tournaments if any player achieves an outright 
win the series ends in six games. Ties involving two players and represented by the partitions 
[3202] and [271] each require a single-game play-off. The expected number of additional 
games on account of these is therefore the sum of the probabilities of the appropriate out- 
comes. The number of additional games due to ties involving three players is evaluated in 
the manner described in § 3-1. 


3:4. Double elimination tournament 


The minimum number of games required in the double elimination tournament with four 
players is six, since three players must lose two games each. Thus the expected number of 
games is six plus the probability of a seventh game. Such a game is required when W W loses 
in the sixth game. Using the record of C, as a basis of classification we may say that a seventh 
game is required in the event of each of the following outcomes: WWLW,WWLL,WLWWW, 
WLWWL,WWWW,andLWWWL. Since the probability of a seventh game is not affected 
by the winning or losing of C, in that game, we may group these outcomes in pairs to give 
WWL,WLWW, and LWWW. In addition, some of the outcomes in which C, is eliminated 
earlier in the tournament may lead to a seventh game. They are WLL, LWL, and LL, a 
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seventh game being required in these cases whenever the player with no previous losses 
loses in the sixth game. Using this classification system, one may determine the probability 
of a seventh game for a given draw. The result for each of the other two possible draws may 
be inferred by appropriate interchanges of subscripts. For the random draw the resulting 
values are averaged over the three possible draws. 


4. COMPARISONS IN SERIES OF NUMERICAL EXAMPLES 


For the purpose of comparing the effectiveness of the six tournament types described 
above, we define a best player as one having a probability greater than } of defeating each 
of the others. Without loss of generality we may refer to the players in decreasing order of 
strength, C, being strongest and C, being weakest. The possibility that some of the players 
C,, C, and CO, may be equally strong is not excluded. We shall consider only situations in 
which circular triads amongst the parameters do not occur; accordingly we assume that the 
six parameters satisfy the following inequalities: 


M4 > M3 > My. > 4, Mog > Mo3'> 4, M3 > Meg > 4, Mig > Mog > Mag > 8- (4-1) 


Table 4-1. Assigned parameter values in three series of examples 


Example no. To3 Toy 134 

Series 1 1-1 0-5000 0-5000 0-5000 
M2 = 0°5400 1-2 -6400 -8500 “6200 
M3 = +6500 1-3 *6127 +8396 -7679 
M4 = *8600 1-4 -6400 *8500 -8200 
1-5 -6500 -8600 -8400 

Series 2 2-1 0-5000 0-5000 0-5000 
742 = 0-7000 2-2 -5758 *7247 -6598 
3 = +7600 2-3 -7500 -8200 -7200 
71, = +8600 2-4 -7500 -8400 -8000 
2-5 -7500 *8500 -8400 

Series 3 3-1 0-5000 0-5000 0-5000 
712 = 0-8000 3-2 +5862 -6923 -6136 
713 = +8500 3-3 -7000 -7500 -7000 
™,= +9000 3-4 -8000 +8300 -7500 
3°5 -8400 -8700 *8500 


Comparisons have been made by assigning values to the six parameters and evaluating 
the two criteria, viz. (a) the probability that C, wins, and (b) the expected number of games 
for each of the tournament types. Typical results in the form of three series of examples are 
presented below. The assigned parameter values, satisfying the inequalities (4-1) are given in 
Table 4-1. In the examples 1-3, 2-2, and 3-2 the values of 7793, 77.4, and 774, have been deter- 
mined from the assigned values of 71,2, 7,3, and 7,, so as to satisfy the mathematical model 
proposed by Bradley & Terry (1952). For the three series and each of the six tournament 
types the probabilities that C, wins are given in Table 4-2, listed in generally increasing order 
of the probabilities involved. The same order of presentation is used in Table 4-3, which 
lists the expected numbers of games for all types except K, (which always requires three 
games). 

It will be observed in Table 4-1 that each series is characterized by a common set of values 
of 77,2, 73, and 77,, in the five examples. Within series the values of 7733, 774, and 773, have been 
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assigned in a generally increasing order of magnitude in the ranges defined by (4-1), starting 
in each case with the lower limit of 4. With this arrangement one finds that the probability 
that C, wins decreases throughout each series for all six tournament types. This is because 
we are giving an increasing advantage to C,, and to some extent to C;, relative to the weakest 
player C,, thus tending to increase the probability that C, will meet later in the tournament 
or in a play-off a player that he has the relatively smaller chance of defeating. 


Table 4:2. Probabilities that C, wins in three series of examples 


Tournament type 
Example A 





jis 
no. Ko R Ky Ky D Ky 
1-1 0-4581 0-5239 0-5279 0-5284 0-5307 0-5374 
1-2 -4249 -4615 -4641 -4669 4711 -4789 
1-3 +4209 -4564 -4581 -4621 -4672 4737 
1-4 -4173 -4503 -4502 *4551 -4618 -4688 
1-5 -4156 -4472 -4463 -4516 +4593 -4667 
2-1 0-5958 0-6910 0-6974 0-7036 0-7212 0-7406 
2-2 -5817 -6637 6714 -6795 -6992 -7179 
2-3 +5734 -6438 -6452 -6564 -6860 -7063 
2-4 -5707 -6393 -6390 -6514 -6826 *7034 
2-5 -5694 -6370 -6357 -6488 -6810 -7022 
3-1 0-7216 0-8190 0-8255 0-8341 0-8592 0-8751 
3-2 *7133 -8028 *8119 *8246 -8491 “8652 
3-3 -7089 -7924 -7996 “8115 -8436 *8602 
3-4 -7044 -7803 *7832 -7977 -8381 *8562 
3-5 ‘7014 *7734 -7726 -7894 *8347 -8540 
Table 4:3. Expected numbers of games in three series of examples 
Tournament type 
Example o_o aia A= = = — 

no. R K, K, D Ky 

1-1 6-8175 6-7796 6-7630 6-4543 7°3301 

1-2 6-7320 6-6978 6-6780 6-4761 7-2401 

1-3 6-7740 6-7174 6-6908 6-4812 7-2255 

1-4 6:7757 6-7121 6-6831 6-4818 7-1962 

1-5 6-7769 6-7097 6-6794 6-481] 7-1808 

2-1 6-6588 6-6298 6-6215 6-4072 7-2080 

2-2 6-6406 6-6139 6-602€ 6-4250 7-1741 

2-3 6-6197 6-5699 6-5649 6-4267 7-0836 

2-4 6-6298 6-5724 6-5629 6-4280 7-0502 

2-5 6-6355 6-5745 6-5620 6-4286 7:0298 

3-1 6-5120 6-4496 6-4514 6-3218 7:0202 

3-2 6-4683 6-4453 6-4569 6-3361 6-9984 

3-3 6-4611 6-4331 6-4337 6-3419 6-9468 

3-4 6-4523 6-4109 6-4154 6-3458 ' 6-8685 

3-5 6-4547 6-4048 6-4055 6-3473 6-7936 


In Table 4-2 we observe that K, is slightly better than F in the early part of each series, 
but that this effect tends to be reversed for the larger values of 7793, 7724, and 7744. The seeding 
arrangement (K,) produces only a small improvement over the use of separate random draws 
(K,). It was remarked in § 2-5 that the only alternative seeding arrangement would involve 
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making a single random draw and using it for both tournaments. This has been found in 
a number of examples to give results which are intermediate between those for K, and K3. 
The latter thus appears to be the optimum available seeding arrangement. In terms of the 
probability that C, wins, Ky is least desirable, D is somewhat better than R, K,, and Ks, 
but K, is superior to all of the others. 

In Table 4-3 we observe that the expected number of games is less for the double elimina- 
tion tournament than for each of the R, K,, and K,. Thus, for the cases considered, the 
round robin and the two knock-out combinations K, and K, always compare unfavourably 
with the double elimination procedure in terms of both criteria. However, the K, type 
apparently accomplishes a higher probability that C, wins at the expense of a higher ex- 
pected number of games, while Ky, although yielding the lowest probability, requires only 
three games. 


In order to effect reasonable comparisons between D, Ky, and K, we set up the cost 


ammanas expected cost = q[1— P(C, wins)]+ expected number of games, (4-2) 


where q is a factor representing the assessed cost of a wrong decision, expressed in units of 
the cost per game. 


Using (4-2) one may find for each example three critical values of q, viz. 


q,: above which D is preferable to Ky: 
q2: above which K, is preferable to D; 
qs: above which K, is preferable to Ko. 


If q, < q2 the interval between these two values is a range of g for which D is better than Ky 
and K,. However, if ¢q, > q, there is no value of g for which D is to be preferred to K, and K,. 


Table 4-4. Critical values of q in three series of examples 


Example Example Example 
no. UN 2 qs no. N q2 qs no. Nn ¥ E) qs 
1+] 47 130 54 2-1 27 41 29 3-1 24 43 26 
1-2 75 97 78 2-2 29 40 30 3-2 24 41 26 
1-3 75 114 80 2-3 30 32 30 3°3 24 36 26 
1-4 78 102 81 2-4 30 29 30 3-4 25 28 25 
1-5 79 94 81 2-5 30 28 30 3°5 25 23 24 


For the three series of examples considered in this section the critical values q,, qo, and qs, 
rounded to the nearest integer below the exact value, are given in Table 4-4. We observe 
that in Examples 2-4, 2-5, and 3-5 there is no value of g for which Dis preferable to K, and K,. 
In the other cases, in which there is a range of q where Dis preferable to K, and K,, that range 
is observed to be, in general, relatively short. Furthermore, upon evaluating the advantage 
of using D instead of K,, for g = q, and also for some other intermediate values in the range 
between q, and qo, it has been found that the largest advantage amounts to only 0-51 (Ex- 
ample 1-1). That is, the advantage of using D instead of K, in a range in which D is prefer- 
able seems to be only about half the cost of one game. In view of these considerations it 
would seem to be best to use Ky for q < q,and K, forq > qs. Since K, is effectively the simple 
tournament with replication in each contest, we conclude that it seems to be better to vary 


the amount of experimentation than to depart from the ordinary (and simplest) form of 
tournament. 
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5. COMPARISONS IN A SPECIAL CASE 
For the special case in which C,, C,, and C, are equal in strength we may write 
Me = M3 =My_= 7 aNd My3 = My = Myq = 4. (5-1) 
Expressions for the probability that C, wins and the expected number of games in each 
of the six tournament types are found in the manner indicated in §§ 2 and 3. If we denote 


the probability that C, wins by P and use the abbreviations for the tournament types as 
subscripts, we find that 


Pp = 1(2—m) +7(1 —7) (2+7+4 2n*)/4(1—7 +77), ) 





Fy, = 7, 
Py, = 7(2—7) + 73(1 — 7) (— 2 + 82 — 47”), ' (5-2) 
Px, = 1°(2—m) + 2n4(1 —77) (3 — 27 +7") /3(1 -—7 +77"), 
Py, = 1(2—m) +m4(1 —7) (4— 32 + 2n?)/2(1-—7+7°), 
and Pp = 73(2—7) + 274(1—7). J 
Similarly, using H to denote the expected number of games, we have 
Ep = 7—3n/2 + 3n?/2 — 73 + 9n?(1 —77)/4(1-—7 +77), ) 
Ex, = 3, 
Ex, = 7+ 20 —7n?/2 + 77° — 1074 + 47°, 
4 (5-3) 


Ex, = 41/6—1 +7?/6 + 2713/3 — 2711/3 + 20°(1 — 7) (2—m)/(1—7 +7’), 
Ex, = 27/4-—1/2—7°/4 + 13 — 74 + 32?(1 —7) (2—7)/2(1—7 +77’), 
and Ep = 13/2 —7?/2 + 273 — 271. 
For the special case, the inequalities (4-1) reduce to 


l>a>t. (5-4) 





From the expressions (5-2) together with the condition (5-4) it may be shown that 
Py, > Pp > Pr, > Px, > Pr > Pr,- (5-5) 


Since it may be shown that Fp is less than each of Ep, Ex, Ex,, and Ex,, the double elimina- 
tion tournament is preferable to each of R, K,, and K, in terms of both criteria. However. 
as in $4, it may be observed that K, yields the highest probability that C, wins at the 
expense of the highest expected number of games, while Ko, although giving the lowest 
probability, requires only three games. 

For the comparison of D, Ky, and K, we again use the cost function (4-2). The critical 
values 4), da, and q3 have been evaluated for nine values of 7, uniformly spaced over the 
range defined in (5-4), and are given, rounded to the nearest integer below the exact value, 
in Table 5-1. Inspection of these values indicates that for 7 < 0-70 there is no range of values 
of q for which D is preferable to K, and K,. For 7 > 0-75 there is such a range, the length 
of which tends to increase as 7 increases. However, upon evaluating the advantage of using 
D instead of K, for 7 = 0-95 and q¢ = qz, it has been found that the advantage is only about 
0-40, or less than half the cost of one game. For smaller values of 7 the advantage is less than 
this. Thus we have again the conclusion that it would seem to be best to use Ky for q < 3 
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‘ ' . Pri 
and K, for q > q,, the choice therefore depending on the emphasis to be placed on the . 
criterion of reliability relative to that of sampling cost. It would appear that, at least for 
four players, there is not much to be gained from varying the ordinary tournament rules, 
so long as one allows variation in the specified number of wins. | 
Table 5-1. Critical values of q in the special case 
a Nn q2 qs 
0-55 165 147 161 
60 75 70 74 
65 47 46 47 : 
70 34 36 34 los 
75 27 31 28 te 
80 24 31 25 
85 23 36 25 ne 
90 26 53 28 1S 
95 39 144 44 sq 
? de 
The author is indebted to Dr H. A. David for suggesting the topic of this research. on 
Appreciation is also expressed to a referee who made some valuable suggestions concerning at 
the original manuscript. 
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Supplemented balance 


By 8S. C. PEARCE 
East Malling Research Station 


1. INTRODUCTION 


In comparative experiments there may be a treatment, usually the control, which is 
logically in a different position from the rest. For example, the purpose of the trial may be 
to compare some new treatments not with each other but with an established one to find 
out if any are worth further study; in this instance it is known that the greatest economy 
is obtained if the control is more highly replicated than the others by a ratio equal to the 
square root of the number of new treat: . ts under test. On the other hand, a trial may be 
designed to suggest which of several courses of action is best and the control is introduced 
only in order to demonstrate the bad consequences of doing nothing. In such circumstances 
a single plot may suffice. 

When designing such a trial an experimenter may well use an orthogonal design as being 
more convenient even though it may not give the optimum replication to the treatment in 
a special position. However, if some restriction on block size or plot number constrains 
him to use a non-orthogonal design, supplemented balance may be of use to him. 

This device was suggested by Hoblyn, Pearce & Freeman (1954) in another connexion, 
namely, the changing of treatments in successive experiments in cases where it can be 
assumed that the new treatments will not interact with residual effects from those pre- 
viously applied. According to their definition a design is in supplemented balance if all 
treatments are replicated r times except the supplementing one, which has r, replicates, 
and if all pairs of treatments concur A times in blocks, unless one of the pair is the supple- 
menting treatment, in which case there are A, concurrences. It is assumed that all blocks 
contain k plots. The treatments will be numbered 0 to v, treatment 0 being the supple- 
menting one; the number of blocks will be written b. 

Expressed more formally, let n be an incidence matrix having b columns and (v+ 1) 
rows, the elements representing the number of times each treatment occurs in each block. 
Also, let 1, be a unit column vector with h elements, and let r be a column vector formed 
from the row totals of n and thus representing the numbers of replicates of the treatments 
(r = n1,). Similarly let k be another column vector formed from the column totals of n 
thus representing the numbers of plots in the blocks (k = k1,, k = n’,,,,)). 

Let n; be the jth row of n, then A = n,n; if neither? nor j equals 0, and Ay = nynj. Further, 
let s; = njnj. This quantity may be termed the number of self-concurrences of treatment j, 
and equals the number of replicates if all elements of n, are either 0 or 1. 

Considering now the matrix, nn’, its diagonal elements will have the values 8;, and its 
off-diagonal elements will equal A, unless the row or column refers to the supplementing 
treatment in which case the element equals Ay. Now 


kr = kn1, = nk = nn‘\,,,.,. 


Hence kr = 8;+(v—1)A+Ay, where j +0, 
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so 8; must be independent of j and equal to s, say. Also 


kry = 8) + VAg. 
A design will here be defined as being of type S if all blocks are the same size and nn’ has 
the pattern 
&® A Ayo ee 
eek, ae me 
ig Acre 
ae oe em 


In this paper reference will also be made to designs of types O, T and P. These have been 
defined previously (Hoblyn et al. 1954) but they can readily be redefined in the present 
notation. Those of type O are orthogonal, and Tocher (1952) has shown that for such designs 
all the columns of n must be the same, if all blocks are the same size. Consequently if all 
treatments are equally replicated, all the elements of nn’ will have the same value, s. In 
designs of types T and P all blocks are of equal size and all treatments equally replicated. 
In type T the incidence matrix, n, is such that all diagonal elements of nn’ have the value s, 
and all off-diagonal elements the value A. This type thus includes all the balanced incom- 
plete block designs. In type P any row or column of nn’ can be obtained from any other 
row or column by permutation, all the diagonal elements being equal tos. Thus all partially 
balanced incomplete block designs are of type P. 

By a design of type X : YZ will be meant one in which there are three classifications of 
the plots, the second classification being disposed with regard to the first in a design of 
type X, the third to the first in a design of type Y and the third to the second in a design of 
type Z. This notation can readily be extended if there are more classifications. 


2. EXAMPLES OF DESIGNS OF TYPE S 


An example is afforded by the strawberry weedkiller trial described by Pearce (1953, 
§38). In it there were four blocks (b = 4) each of seven plots (k = 7), and there were four 
treatments, A, B, C and D, (v = 4) besides an untreated control (O). It was designed thus 


Block 


a 





a 
= 
_ 
_ 
-_ 


YOWPPOO H) 
DUAWPOO 
Yyawwroo 
yaawpoo mJ 


Here r = 5, ry = 8, A = 6, Ay = 10, s = 7 and 8, = 16. 


Another example is provided by a strawberry manurial trial recently designed at East 
Malling. In this the non-supplementing treatments formed a factorial set, being made up 
of dung (D) or no dung (N) applied before planting, and three levels of inorganic nitrogen 


? 





th 


as 





ar 
us 


eli 
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(0, 1 or 2) applied annually. The supplementing treatment (S) was straw incorporated into 
the soil before planting to depress the nitrogen level. The design was 





Block 

ct A— - ee 
I II III IV V VI VII VIII IX 
NO NO Nil NO NO NO NO NO NO 
Nl Nl N2 Nl Nl Nl Nl Nl N2 
N2 N2 DO N2 N2 N2 DO N2 DO 
D1 DO D1 DO DO DO D1 DO D1 
D2 D2 D2 D1 D1 D1 D2 D1 D2 

Ss Ss Ss D2 Ss D2 NY D2 Ss 


Here r = s = 8, rp = 8) = 6, A=7 and A, = 5. 


Some similar designs were described by Tocher (1952), for example, A and C on his 
page 85. 
3. THE ANALYSIS OF DATA WHEN THE DESIGN IS OF TYPE S 


Let « be a general parameter, and let B and y be column vectors of the block and treat- 
ment parameters, respectively, subject to the constraints that k’B = 0 and r’y = 0. 

Also, let B and T be column vectors of the block and treatment totals respectively, and 
let r* be r written as a diagonal matrix. 

Then, following the lines indicated by Tocher (1952), 


T = ra+n6+r*y+an error term, 
Y 


B = ka+kB6+n’y+an error term. 
Defining a column vector, Q, by the equation 

kQ = kT—nB, 
then kQ = (kr*—nn’) y+ an error term. 


Writing ‘the expectation of’ as Z, it follows that for 7 + 0 
E(kQ;) = (kr—8) fe AoYo—A =X Va 
h+0.J 


= (kr —8+A)y;+ (T9A—TAp) Yo/r 
= k(dy;+ yo), say. 
E(kQo) = (kry— 8) Yo—Ao =X Vn 
h+¥0 


= (kry—8y+ToAo/r) Yo 


=kd'yo, say. 
Since kr = 8+(v—1)A+Apy, kro = 89+ Ag, 
it follows that d = (vA+A,)/k, $' = bA,/r 


(N.B. the total number of plots in the experiment, N, is expressible either as bk or 
as Ur +7o.) 
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The treatment parameters can accordingly be estimated in terms of the data thus: 


Po = V/¢', 
and, for j not equal to 0, >; = (Q;-—£Q,/9’)/¢. 
Using these estimates it is known from the work of Tocher (1952) that W, the treatment 
sum of squares, equals Q’Y. It is most easily computed in that form, but, because the 
elements of Q sum to zero, it may also be written 
2, +6 1{/ so, AG 
jE Gp B= GE A454 

Since the sum of squares within blocks is made up of two components, one due to treatments 
and the other to error, the evaluation of the first of these enables the analysis to be com- 
pleted readily. 

The adjusted mean of the jth treatment equals (« + y;), « being estimated by the general 
mean, namely G/N, where G is the grand total of data. 

The difference of }; and );, where neither i nor j equals zero, is given by (Q;—Q;)/; 
hence it follows from the lemma given by Freeman (1957) that the standard error of the 
difference of two adjusted means, the supplementing treatment not being involved, is 


{2 x error mean-square/¢}}. 


If, however, the supplementing treatment is being compared with one of the others the 
standard error is 


{(6+¢’ + ¢) error mean-square/(¢’)}4 = {(1+A/A,) error mean-square/¢}}. 


All comparisons will have equal precision if and only if A = Ao. 

Another special case arises when r = 7p. Although supplemented balance has been 
recommended on account of its permitting unequal replication, the definition does not 
require this property. Usually in a general three-class design of type X: YZ, if Y = S and 
the replication is unequal, Z also must equal 8. If, however, replication is equal this is not 
necessary. 


4. A NUMERICAL EXAMPLE 


Some data from the strawberry weedkiller trial mentioned above have been published 
(Pearce, 1953, Appendix III). They will here be analysed again using the method just 
given. 

The purpose of the trial was to find out whether any of the weedkillers, A, B, C or D, all 
of which were apparently suitable for controlling weeds in strawberry fields, would harm 
the fruiting plants. The data represent the total spread in inches of twelve plants per plot 
approximately two months after the application of the weedkillers. The comparisons of 
most interest are those of A, B, C and D with the control, O. 


Block I Block IT Block III Block IV 
C, 107 A, 136 B, 118 O, 173 
A, 166 O, 146 A, 117 C, 95 
D, 133 C, 104 O, 176 C, 109 
B, 166 B, 152 D, 132 A, 130 
O, 177 D, 119 B, 139 D, 103 
A, 163 O, 164 O, 186 O, 185 


O, 190 D, 132 C, 103 B, 147 


, 





~~ pa am | UCC 


an 





\ 


ct ct KH 
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The incidence matrix, n, is 


PQauPo 
— ee DODO eS 
bdo — — = bo 
— ee DOS bo 
— b= — bO 


The block totals are respectively 1102, 953, 971 and 942. The grand total, G, is 3968, and 
the treatment totals respectively 1397, 712, 722, 518 and 619. 
The next task is to evaluate the Q’s: 
kQo = 7.1397 — (2.1102 + 2.953 + 2.971 + 2.942) = + 1843, 
kQ, = 7.712 — (2.11024 1.953 + 1.9714 1.942) =— 86, 
kQ, = 7.722 —(1.1102 + 1.953 + 2.971 +4 1.942) = + 115, 
kQo = 7.518 —(1.1102 + 1.953 + 1.971 + 2.942) = — 1284, 
kQp = 7.619 — (1.1102 + 2.953 + 1.9714 1.942) = — 588. 


These quantities should always sum to zero. 
Here it should be noted that 


kdb = vA+ Ay = 34, krd’ = bkA, = 280, 
and kr€ = rpA—rdAy = —2. 
Hence, (kd) (kr$’) Fo = r(kh) (kQo) = 313,310, 
(kd) (krp’) }, = (kerp’) (kQ) — (kerS) (kKQo) = — 20,394, 
(kd) (kr $') Py = (krG’) (kQy) — (kr) (kKQo) = —-35, 886, 
(kd) (kr $’) Po = (kerG") (Qc) — (krS) (kKQo) = — 355,834, 
(kp) (Ier$') py = (erg") (kQp) — (rb) (kQo) = — 160,954. 


When weighted by the numbers of replicates these quantities must always sum to zero. 

The treatment sum of squares is obtained by multiplying each value of @ by the corre- 
sponding value of } and adding the products. This gives 1,134,842,912/7.34.280 = 17,029-45, 
which is nearly the same as the figure of 17,029-49 obtained previously using a different 
method (Pearce, 1953, Appendix III). The total sum of squares of data within the experi- 
ment is 22,855, of which 20,490 lies within blocks and 2,365 between blocks, so the analysis 
of variance table is: 








Source d.f. Sum of squares Mean-square 
Blocks (unadjusted) 3 2,365 — 
Treatments (adjusted) 4 17,029 _- 
Error (by difference) 20 3,461 173-0 

Total 27 22,855 - 


This inquiry specifically concerns the difference between each weedkiller and the control. 
Formulae have been given for adjusted treatment means, but as long as only differences 
are in question, it is enough to compare parameters, thus: 
Jo-Pa = 35-05, Po—Pz = 29°14, 
Yo—P%o = 70:29, Po—Pp = 49°82. 
17 Biom. 47 
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All these differences are positive, and suggest that all the weedkillers have harmed the 
strawberry plants to some extent. The standard error of these differences is 


{(1+A/A,) error mean-square/¢}* = 7-55, 


and this shows that all the differences are in fact significant at a high level, especially when 
it is considered that one-sided tests may be used. 
It may be noted that the efficiency factor for these comparisons is 221/224, or virtually 
unity. 
5. DESIGNS OF TYPE O:SS 


In these there are initially two mutually orthogonal classifications (type O), whether 
of rows and columns or of blocks and former treatments, and a third classification (treatments) 
is made in such a manner as to be in supplemented balance with regard to both the earlier 
classifications (type O0:SS). For example, in these two instances the treatments are so 
disposed with regard to both rows and columns: 


A A B C O A BCOA 
B OC A B OC ABC 
C BOOA B A OC B 
OC ABC 
Cc A BOO 


In the first example the values of k, A, s, etc., are the same for both schemes of supplementa- 
tion; in the second they are different. Both designs belong to special classes already 
described (Pearce, 1952). Latin squares with a row and column missing (Yates, 1936) are 
also of type O:SS. 

In these designs there are in effect two sets of blocks, whatever names may best describe 
the two initial classifications in particular cases, and there is a scheme of supplemented 
balance for each. The same notation will be used as before, one system of blocking being 
indicated by a cross and the other by a circle. There will be two incidence matrices, n* 
and n°, two vectors of block parameters, B+ and B°, and so on. 

For these designs Q is defined as 


T —(nB/k)+—(nB/k)° +rG/N = [r?—(nn’/k)* —(nn’/k)’]y, 
ie. sj + 0) = [r— (o/h) — (a/h)"175—[A/R)* + AIRY] & Ya—UAalk)* + Aol )"I 70 


= - CE) Ce) (ey +a) 


= pyj+ So, say. 
Qo = [7o— (8o/k)* — (80/k)° 1 Yo — (Ag! k)* + (Ao/k)°] 2% 


ToAg\t Toro\° 
= [ro (0-54) (10-5) Jo 


='Yo, say. 


With these new values of ¢, ¢’ and ¢ the same formulae as before may be used for evalu- 
ating the parameters, the treatment sum of squares, the standard errors, etc. Where, how- 
ever, simpler formulae are given for type S in terms of other quantities they will not in 
general apply to type O:SS. 





~~ FF he hl RCC 


_— i —_ fe te 





Supplemented balance 269 


In working out the analysis of variance it is necessary first to remove from the total sum 
of squares components due to two blocking systems, not one as for type S, but this causes 
no difficulty because the two are mutually orthogonal. It then remains to apportion W 
to treatments and the rest to error. 


6. DrEsiaNns oF TYPE O:O§, ETC. 


Such designs exist and could very well be of use, though they do not appear to have any 
outstanding advantages. For example, if it were a question of applying four treatments to 
an already determined system of four rows and six columns, designs of both types O: SO 
and O: PO are available, thus: 


0:S0O, O BOA CA O:P0, O B C A O B 
BC C OA O BAOC A C 
A OBC O B A C BOC O 
C A A BBC C OA BBA 


In the design of type O: SO comparisons involving O have an efficiency factor of 140/153 
and the others 35/36. In that of type 0: PO (O, A) and (B,C) are first associates; com- 
parisons within these pairs have an efficiency factor of 17/18 and others 34/35. In general 
efficiency the designs are not very different, and the choice between them would largely 
depend upon the comparisons to be made. 

If a design of types 0: SO or O: OS is adopted, the analysis of its data is simple. Because 
there are two blocking systems two components must be removed from the total sum of 
squares as is done for type 0:SS. However, the treatments are disposed in supplemented 
balance with regard to only one blocking system and only this need be considered in the 
evaluation of Q, ¢, ¢’ and ¢, the formulae for type S being appropriate. 

Designs also exist of types O: PS, O:SP, O: TS and O:ST, for example, 


O:ST, A O C O O B O:SP, O B A O 
Oo C OBA O A A BC 
BC ABA C B C OO 
A A C C B B C BBA 
Cc BBACA 0 OC A 
Oo BOA C O A CC B 


However, none have been found with any obvious advantages. 


7. Dxsiagns oF TYPE 0:00:SSS 


In these designs there was initially an orthogonal three-way classification (type O : OO) 
to which a fourth classification, treatments, has been added so as to be in supplemented 
balance in relation to the existing three (type O:00:SSS). The most likely use arises in 
adding a further set of treatments to a Latin square as in these examples, where capitals 
represent the original treatments and small letters the new ones: 


Aa Bb Co Da Aa Bo Ce Dd 
Bo Aa Db Co Bd Ab Da Co 
Cb Do Ba Ab Cb De Ao Ba 
Db Ca Ao Bo Do Cd Bb Ac 


In such instances the values of k, s, A, etc., will be the same for each scheme of supplementa- 
tion, and this will be assumed in what follows. However, generalization would be easy if 
it were ever called for. 


17-2 
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If further treatments are added to a k x k Latin square, the three blocking systems being 
represented by a cross, a circle and an asterisk, then 


Q = T-[(nB)* + (nB)° + (nB)*)/k+ 2rG/N 
and @ = r—3(s—A)/k, 

Q’ = ry — 389/k + 3Agro/kr. 

€ = 3(rygA—rA,)/kr. 


Again all the formulae for type S may be used as long as they are expressed in terms of ¢, ¢’ 
and ¢. The simplified formulae will not in general apply to the more complicated types. 
Also, there are now three components to be extracted from the total sum of squares before 
the remainder can be apportioned between treatments and error. 

Where (k + 1) treatments are added to an existing k x k Latin square there does not appear 
to be any good alternative to the type of design considered here, but if there are (k—1) 
treatments it is possible in many cases to use a (k— 2, 1") orthogonal partition as described 
by Finney (1945, 1946a,b), and the question arises which design is to be preferred. For 
the comparison of the control with another treatment the orthogonal partition is always 
better; for the comparison of two treatments neither of which is the control the supple- 
mented design will have the advantage. For some transformation sets of the original Latin 
square, either or both of the designs may be impossible. 


8. DUALS OF SUPPLEMENTED DESIGNS 


If blocks and treatments are interchanged, the resulting design is said to be the dual of 
the first. Thus, if the supplemented scheme already used in the design of type O: SO above 


is taken, i.e. 
Block 


rPQaProwo 
BPOaQWOP 
QW PQ 


and the blocks, I-IV transformed to treatments, A’, B’, C’ and O’, and the treatments, 
A, B, C and O, to blocks, I’-IV’, the result is 


Block 
‘ hoo oe 
I I] II!’ IV’ 
A’ A’ A’ A’ 
A’ B’ B’ A’ 
B’ C B’ B’ 
C’ C’ C’ B’ 
0’ 0’ 0’ C’ 
0’ 0’ 0’ C’ 


which is the original design again, i.e. it is a self-dual. 
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Usually, of course, the position is more complicated, but a study of duals is worth while. 
For one thing, if a design has an intelligible dual the adjusted block totals and block para- 
meters are easily derived, and a ready check on the computing obtained by calculating the 
error sum of squares in a second way independent of the first. For another, duals may them- 
selves be of use as designs, not only the duals of type S but of more complicated types as 
well; they may appear to be complicated, but the error sum of squares can be obtained by 
calculating that of the original design, a procedure that will necessarily give the same result, 
the difference between the two schemes lying only in the names given to the classifications. 
If now the treatments of the duals (blocks, etc., of the original) are ignored, the resulting 
design is likely to be quite simple, having only one classification if the basic design is of 
type S, and a new error sum of squares can be calculated. Its excess over the one previously 
obtained will represent the amount due to the classification ignored, i.e. treatments. The 
formula for standard errors may be complicated, but it can always be derived, and this 
should be done before starting the experiment lest the precision prove unsatisfactory. 

In general, a design of type S has unequal replication; when dualized to one of type S’ 
it will have unequal block size. This is not often called for, but sometimes it is useful to have 
designs available that permit it; for example, when experimenting with litters of differing 
size. 


SUMMARY 


Supplemented balance is described, and some uses indicated. A method of analysis is 
given, both for designs with two-way classifications and for those with more. 


Iam much indebted to Dr G. H. Freeman and Mr P. Sprent for their interest and helpful 
comments. 
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The efficiency of blocking in incomplete block designs* 


By JOHN LEROY FOLKS 
Texas Instruments Incorporated and Statistical Laboratory, Iowa State College 


anpD OSCAR KEMPTHORNE 
Statistical Laboratory, Iowa State College 


1. Summary. Procedures for estimating the relative efficiency of certain designs have 
been considered by Yates (1935), Cochran & Cox (1957), and Kempthorne (1952, 1955). 
In this paper the efficiency of blocking in general is considered. A general formula for any 
incomplete block design of fairly general form is obtained. 


2. Introduction. In many experiments one has the option of choosing from a wide class 
of designs ranging from designs involving no blocking to designs involving two-way 
classification of experimental units. A measure of the efficiency of one design relative to 
another is the inverse ratio of the variances with which treatment differences are estimated 
in the two designs. Given that design A has been used, estimation of its efficiency relative 
to some other design, B say, requires that we estimate the error variance of design B from 
the data obtained from design A. 

A common elementary situation is that a randomized block design has been used and it 
is desired to estimate the error variance had a completely randomized design been used. 
The formula for this purpose is well known, but we wish to summarize a few of the salient 
points of the randomization theory upon which it is based. Throughout we shall concern 
ourselves only with variability over which we randomize. 

Consider the conceptual population of yields that would be obtained if every treatment 
could be applied to every plot. Denote the yield with treatment & (= 1, 2,...,¢) on plot 
j (= 1, 2,...,t) of block ¢ (= 1, 2, ...,r) by X;;,. Then we may write an identity 

X ijn = X__+(Ki.-—X_..) + (Xijn— Xe.) + (Ky. -Xi..), 
where the dots indicate averages over the subscripts omitted. The estimation of variance 
under randomization of observed mean treatment differences is possible only if additivity 
of treatment and plot effects holds, or, with another mode of expression, the treatment 
effects do not depend on the plot. The additivity assumption leads to 
X ijn —Xij, = ty for all i, j. 

In order to develop the argument on efficiency of blocking this relationship must be assumed. 
We can then write Xj = Mt +t Hey 


with an obvious identification of symbols. However, we cannot observe the yield of treat- 
ment k on every plot but only the yield of treatment & upon a randomly chosen plot in each 
of the blocks. For such considerations the design random variables (Kempthorne 1952, 
1955) described below have been found helpful. "et 


ok =1 if treatment k is assigned to plot j in the ith block 
=0 otherwise. 


* Journal Paper Number J-3571 of the Iowa Agricultural and Home Economics Experiment Station, 
Ames. Project 890. 
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From elementary probability considerations we have 
E(6%;) = lft, 
df df; = 0, 
Of, 8%; = 9, 
E(ék, dF.) = 1/t(t—1), ete. 
Denote the observed value of treatment k in block i by y;,. Then 
Yu = DOF X isn 
J 
= B+b +t + D Oey. 
J 


The random variables in this expression are the 6*,, and their distribution is determined by 
the randomization procedure. This allows us to evaluate the expected sums of squares 
appearing in the ordinary analysis of variance. For instance, the treatment sum of squares 
is equal to 1 2 
EU.) = B (tet Bahu) 
ik vi 


ik 


and it can be verified that 


E (treatment SS) = r > #+ BS X (= of e:5)? 
k k i 


1 
r DH+-—Dde;. 
k Y ij 


The expected values of sums of squares for the analysis of variance of randomized blocks are 
shown in Table 1, and in particular the expected error variance is 


1 2 
r(t—1) 2 ii: 


Table 1. Analysis of variance of randomized block design 


Due to aie d.f. E(SS) m.s. 
Blocks r—1 tb? B 
i 
1 
Treatments | -De+r Ut — 
vi k 
r—1 3 
Error (r—1)(t—1) — De; E 
r#¥ 
Total rt—1 Lei, +t Dop+r Teg — 
ij i k 


If a completely randomized design had been used we would be observing X;;, for r com- 
binations of ¢ and j for each value of k without the restriction of randomized blocks that we 


get only one ij combination with a particular value of i for each k. So if we again use design 
random variables 6%; the property 


no longer holds. In the randomized blocks design treatment k cannot occur on both of 
plots j and j’ of block i. But when we randomize ignoring the blocking, plots in the same or 


< meer 


\- 


yf 
r 


Efficiency of blocking in incomplete block designs 275 


in different blocks are given exactly the same status. The mechanics of working out the 
consequences of the different properties of the d’s need not be presented here (Kempthorne, 
1955). They lead to the analysis of variance in Table 2. The expected error variance in this 


case is (Se) 4D 0H/[(rt—-1). 
ij i 
From Table 1 we see that this quantity can be estimated by 


(r—1)B+r(t-1)E 
7. — . <a 


Table 2. Analysis of variance of completely randomized design 





Due to ee d.f. E(SS) 
t-1 = 
Treatments t—1 —— (Lett Doj+r De 
rt—1 ij i k 
ur—1 
Error t(r—1) (YD yt 42503) 
rt—1 ij i 
Total rt—1 Dez +t Doe+rdz 
ij i k 


The notable fact about this expression is that it is obtainable by simulating an experi- 
ment in which the treatments have no effect by using an actual experiment in which there 
are treatment effects. In the case of a completely randomized design using the same plots, 
the expected error mean square is equal to the total mean square which would be observed 
with dummy treatments. This is therefore estimated by pooling the sum of squares for 
blocks, the estimated sum of squares for treatments under the assumption of no treatment 
effects, and the sum of squares for error, i.e. 


(r—1)B+(t-1) #+(r—-1)(¢-1)£# 
inet: © wee 


For this type of argument, which was used first by Yates (1935), to be valid it is necessary 
that the designs under consideration be unbiased designs, i.e. designs for which the expected 
value of the treatment mean square with zero treatment effects is equal to the expected 
value of the error mean square. It is important to realize that the substitution of error mean 
square for treatment mean square and pooling of resulting sums of squares is merely a 
computational algorithm, the justification of which can be obtained by the expectations 
of mean squares under randomization. 

The problem we are concerned with is the efficiency of the blocking in any incomplete 
block design. We suppose that the results of an incomplete block design are available, and 
we wish to estimate what the error variance would have been had we not used the blocking. 
This information alone would not tell us the actual efficiency of the incomplete block 
experiment relative to an unrestricted experiment. In the incomplete block design there 
may, and usually will, be treatment comparisons of various precisions, these precisions 
depending on the particular way the confounding with blocks affects each possible treat- 
ment comparison. The loss of information due to confounding alone is conveyed by the 
efficiency factor of the design or by the efficiency factor for each possible comparison. These 
efficiency factors are consequences solely of the structure of the incomplete block design, 
are usually specified when the method of analysis of an incomplete block design is presented, 
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and are entirely unrelated to the efficacy of the blocking in controlling variability in a 
particular experimental situation. For example, to estimate the mean variance of intra- 
block estimates of treatment differences for the incomplete block design in which each 
treatment is represented r times we use the formula 


2(intra block error mean square)/(rZ), 


where £ is the overall efficiency factor of the design. The mean variance of estimated treat- 
ment differences if no blocking had been used would equal 


2(unrestricted error mean square)/r. 


We will know the intra-block error mean square for the incomplete block design and the 
efficiency factor of the design and to estimate the loss or gain from the blocking we need to 
estimate the unrestricted error mean square, i.e. the error mean square if no blocking 
had been used. 


3. Randomization analysis of incomplete block designs. We shall consider an arbitrary 
incomplete block design, the only restrictions being that each treatment is represented 
r times and the block size is a constant k. This includes the case of balanced incomplete 
block designs, partially balanced incomplete block designs (p.b.i.b.), and rectangular 
lattices which are not p.b.i.b. designs. It is convenient to use a formulation in which one 
distinguishes a design and a master plan. A master plan is a specification of the arrangement 
of treatments in sets or arrays. A design is generated from a master plan by using a random- 
ization procedure which specifies the probabilities of the possible combinations of the treat- 
ments in the plan and the pieces of experimental material. The master plan plus the random- 
ization instructions comprise the design. A particular realization of the process is the plan 
of the experiment in the ordinary sense of the word. 

The situation is summarized as follows: 


(a) There are r groups (i = 1, 2, ...,7) of blocks (j = 1, 2, ...,b) and each block has k plots 
(m = 1,2,...,k). 
(6) The master plan is of the form 
(1) There are r subplans (i’ = 1, 2,...,7r). 
(2) Ineach subplan there are b sets (uw = 1, 2, ...,b) of kof the treatments (r = 1, 2, ...,k). 
A treatment is not necessarily confined to one set, though for resolvable plans this is the 
case. There is no necessity for the master plan to be balanced except that each treatment is 
to occur R times in each subplan. 


(c) The randomization is: 
(1) Subplans are assigned to groups arbitrarily. 
(2) Given a group of blocks and the subplan assigned to it, sets of treatments are 
assigned to blocks at random. 
(3) Given a block and the set of treatments assigned to it, the treatments in the set 
are assigned at random to the plots of the blocks. 


All analyses that we consider are made within groups of blocks so we shall ignore the first 
part of the randomization and identify subplans and groups by the same subscript i. The 
population model of conceptual yields assuming additivity (of treatments and plots) is 


X ijnuy = HAT AO: + ei jim + tines 


~~ 





in 1 


Th 


Let 


Th 


It 


an 
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in which 4¢=1,2,...,r 
j =1,2,...,6 denotes block within group; 
m= 1,2,...,k denotes plot within block; 
b 


@= I, 2,5, 


denotes group and subplan; 


denotes set within subplan; 


v=1,2,...,k denotes treatment within set. 


The following relationships hold among the quantities in the model 
Drs = Dy = Deigm = Vtiuy = 0 
v J m uw 


Let ait = 1 if the wth set is assigned to the jth block in the ith group 
=0 otherwise, 


iim = 1 ifthe uwvth treatment is assigned to plot m of the jth block of the ith group 
= 0 otherwise. 


The observed yields are given by 


ay iu pi 
Yiur co Da; 4 Bivin X ijimuv 
n 


jy 


= + tbuyt ~ Oi Dis +S OS Bi Csim 
jm 
= M+ +hiuny + Bru +YViuy» Say. 
It can be shown that 


E(B) = 9, E(B; iu) = 5 Ee E(X Bin)? = = 5B 


E(> Bin) (2 Pew) = D bi; (wu + u') 


ai 1)Z 


and that E(Y ine) = 0, E(Yiu0) = az Chim: 
jm 


E> Yiwo)? as se D> elim 


ijm 


E(> Yiuv) (x Vine’) =0 (u+ u'). 


Weshall now find expected values of sums of squares appearing in the analyses of variance. 


E (total SS) = BY (Yiuv—y...)? 


iuv 
=H p> (7; + tiup + Bin si Teal 
iuv 


= BkIA+T ytkD, +De 


at “iim? 
iuv ij ijm 


E (group SS) = bk > 77, 


E (block ignoring treatment SS) = ES (y;,.—y;..)” 
iuv 


u 


1 1 2 
= E> (Stowe + Boa + ZE You) 
v v 


iuv 


v 


1 
“7 k py (Xtiwe)P? +%X bi. 
iu u 
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The expected error sum of squares can be obtained by using the fact that the incomplete 
block designs considered are unbiased. This gives 


rbk—rb-t+1 


E (error SS) = rb(k—1) Chim: 
ijm 


The expectation of the adjusted treatment sum of squares can be found by subtraction 
to give analysis of variance I. 


Table 3. Analysis of variance I of incomplete block design 


Due to se d.f. E(SS) 
Groups r—1 bk 2 ri? 
Blocks ignoring treatments r(b—1) sz (Xtiny)? +k - bis 

oi uv 
t-1 
Treatments adjusted for blocks t—1 —— ¥ élim+ Dtino— 4. (Xtiue)? 
rb(k =) ijm iuv k iu ov 
rbk —rb—t+1 
Error rbk—rb—t+1 X Cism 
rb(k—1) ijm , 

Total rbk—1 a 


To obtain the expectation of the unadjusted treatment SS, let 


6%, = 1 if the wth treatment corresponds with iwv index 


=0 otherwise, 


6;, = 1 if the wth treatment occurs in the wth block in the ith group 
= 0 otherwise, 
where Loin = 6% 


1uv Ww? 


Dov, = R, 


wu 
u 


E (unadjusted treatments SS) 


2 
= E rR x OR View — >> x Pee) 


D fav + BEE ORB)? + EEE Ske Yiue! 
iuv w iu w tv 

a t(b—R) 

oes, 2D fiw + rb(b — 1) 2%; bi; +5) >» Clim: 


ij m 


This enables us to compute the expectations for analysis of variance II, which is required 
to estimate the error variance had no blocking been performed. Table 3 is useful in that the 
sum of squares for blocks ignoring treatments plus the sum of squares for treatments 
adjusted for blocks is equal to the sum of squares for treatments ignoring blocks plus the 
sum of squares for blocks eliminating treatments. The easiest way to get Table 4 is by way 
of Table 3 and the expectation of the sum of squares for treatments ignoring blocks. 


Th 


eli 
lat 


Ki; 
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Had no blocking been done within groups, the analysis of variance with dummy treat- 
ments would have been that given in Table 5. The proper error variance for this case is 


1 
r(bk—1 (Selim +k bi, ;)- 


) ijm 


This is estimated by 





Table 4. Analysis of variance II for incomplete block design 


Due to ae d.f. m8. 
Groups r—1 bk Uri — 
i 
Blocks eliminating treatment: (b—1) is 
ocks eliminating treatments r(b— Crim - 
. rbk(Ie— 1) im i 
a ae R) bt ‘“ 
‘rb(b— ij * 
‘ : e t (b—R) 
Treatments ignoring blocks t—1 aD eee mae meds) 
Pe 70k im" rb(b—1) 3 
+ Z tiv 
iuv 
bk—rb—t+1 
Error rbk—rb—t+1 : =o By Sic E 
rb(k—1) ijm 
Total rbk—1 — 


Table 5. Analysis of variance with dummy treatments for no blocking within groups 


Due to rae d.f. E(SS) 
Groups r—1 bk Zr r 
Within groups r(bk — 1) LV elim tk Ubi; 
ijm ij 
Total rbk—1 LDelim +k : bi; + bk a r; 


ijm 
Special cases 


(1) When # = 1, the formula reduces to a simple pooling of the sums of squares for blocks 
eliminating treatments and for error. This includes all the lattice designs, rectangular 
lattices, and confounded factorials arranged in complete replicates. 

(2) Randomized block with r blocks, ¢ treatments. The formula given above reduces to 


ji af. fist, (—0 5) wa A a 
which agrees with the formula in § 2. 
Example r=1, =13, b=13, R=4 k= 4, 
52 | 12B-9B/4 


51 i 52 —39/4 = (64B + 157E)/(13) (17). 
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With the incomplete block design the variance of treatment differences is estimated to be 


R(k—-1)t _ 
The variance of treatment differences had a completely randomized design been used is 
estimated to be 2K’ |R = 2E'/4. 
Hence the relative efficiency of the incomplete block experiment is estimated to be 
E' [4k : 4B 157 
zie” 13£'/(16#) = 17K * (16) ( (17)" 


This estimate of relative efficiency does not utilize the interblock information and is there- 
fore unreliable if interblock information is usable. 


4. Randomization analysis of designs involving two-way classification of experimental 
units. The experimental situation is summarized as follows: 

(a) There are r groups (i = 1, 2,...,r) of bk plots, and each group consists of k rows 
(j = 1,2,...,%) and b (m = 1, 2,...,b) columns. 

(b) The master plan consists of r sets within each of which each of ¢ treatments 
(w = 1,2,...,t) is represented R times. Within each set the treatments are arranged in a 
bx k array and a treatment in the ith group is identified by wu, its row number, and 2, its 
column number. 

(c) The randomization is 

(1) Sets are assigned to groups arbitrarily, and the same index 7 is used to designate 
group of plots and set of treatments. 

(2) Within each group the rows and columns of the treatment array are assigned at 
random to the rows and columns of the plot array. 

The population model of conceptual yields is 


X ijmuv = +8, + ij + Com + bie + Cj: 
with x8; = Uri ” DZ Cim bc X etim - DX sim = D biuv = 0. 
t J J m uv 


m 


Let «ai*=1 if uth row of the ith treatment array is assigned to the mth column 
of experimental urits in the ith group 


= 0 otherwise, 


fp, =1 if vth column of the ith treatment array is assigned to the mth 
column of experimental units in the ith group 


= 0 otherwise. 
The observed yields are given by 
Yiu» = py ae; tons X ijmuv = PM+8, +A + Biv + Yiu + Coun: 
jm 


We can easily obtain the expectations of certain sums of squares. 


im ijm 


E (total SS) = bk dD 83+b SY 73,+k Dcint CGimtrR VE, 
i ij w 


FE (group SS) = bk > 83. 


———EE 
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Let ov, =1 if wth treatment = iwvth treatment 


=0 if otherwise, 


E (unadjusted treatment SS) 


= 5 x [x Ow Yiuv — (1/t)> p> Oi Yiurl® 

t k-R t b-R 
rk(k-1)7 ity 6-1) Dom 

t (k—1)(6—1)+(R-1) 


rbk  (k—1)(b—1) Chim: 


ijm 


= =fRX t+ 


We then have the analysis of variance in Table 6. 


Table 6. Analysis of variance for two-way classification 








Due to ies d.f. E(SS) 
Groups r—1 bk x # 
R 
Rows and columns r(b+k—2) sats = — 2 Gi 
eliminating treatments rbke(ke— 1) ( 1) iim 
rbk—tk—R EP 
eee r2, 
rk k-1 iy . 
rbk—t b—-Rk Ec, 
rb b-1 im 
: : t R-1 2 
Treatments ignoring rows t—1 1+—~ DX lism 
and columns rbk (6-1) (k—1) tim 
tk-Ry i, tb-R 
+g3-12°*ae-i 
+REE, 
r(k—1)(b—1)—(t-1) 
Error r(b—1)(kK—1)—(¢-1) —3@ 
M(b-1)(kK—-1) tim 
Total rbk—1 Delim +b Lrij+k Sc. 


ijm ay im 


+bk Det +rR Dt, 


w 


If treatments were completely randomized within groups the error variance would be 


OER EAimt BE in +b Shp. 
For R = 1, this is estimated by pooling the error and rows and columns (eliminating treat- 
ments) sums of squares. This is the case for lattice squares. 
For the Youden squares, including Latin squares and extended Youden squares, biocking 
may be done by rows or columns alone, as opposed to complete randomization. 
Consider the Youden squares where every treatment occurs in every row, i.e. 


b=t, R=k. 
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We have the analysis of variance given in Table 7. 


Table 7. Analysis of variance for Youden square 


Due to nae d.f. E(SS) 
Groups r—1 bk Xs? 
ij 
Rows r(k—1) bIri; 
ij 
Columns eliminating b—k 
treatments (6-1) > eiim 


rk(k— 1) (6— 1) jm 


+[2- oon |= zs 


b 





‘Treatments ignoring rows t-1 > die 
and columns rk(b— | a ) ni 
tie 
+e-1 ne > Cim+trR 2 

Error r(k—1)—1][b-1 1-——— | 3 dn 

[7( =i ] [ ex |, hd 
Total rbk—1 bk Bet +b Drigt bcm 

+ Dein trR Ee 


im 


In this case the error variance ii treatments had been completely randomized within 


groups is estimated by 
r(b—1) B- (=“)e 
rk(b—1)—(b—k) 
rk(b—1) 





ae 1 a. 


The error variance for randomized blocks within groups with blocks made up by rows 


is estimated by 


r(b—1) B- (- “F)2| 


1 k 


F = --0- a ee 





rk(b—1) 
If blocking is done by columns, the error variance is estimated by 
an 1 
F = 3-7-0 1) "e- 1) A+r(k—1)(b—1) E}. 
It should be noted that when k=b=t, r=l, 


the preceding formulae reduce to the usual ones given for the Latin squares. 
As an example consider a Youden square for which 


R=4, r=1, b=t=7, and k=4; 


A = row mean square; 


= column eliminating treatments mean square; 
E = error mean square. 


rk(b —1)—(b—k) 
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Had a completely randomized design been used 


6B-3E/4 


s 1 
27 (24—3)/24 


E’ = 37 | 18H +34 + 


= }(40E/7+ A +16B/7). 


Had blocking been done by rows 


B= i {ise+ | = 4(40E/7 + 16B/7). 
24 


Had blocking been done by columns 
E’ = 3{384+4+18F] = 3[4+6£]. 
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Queueing with balking. II 


By FRANK A. HAIGHT 


Institute of Transportation and Traffic Engineering, 
University of California, Los Angeles 


1. INTRODUCTION 


We consider a stochastic model proposed in an earlier paper (Haight, 1957, which will 
be referred to as QWB) which may be described briefly as follows: arrivals to a queue occur 
at instants which constitute a homogeneous Poisson process with parameter A. Each arrival 
will join the queue if its length is K or less and otherwise balk, i.e. go away and not return. 
The distribution of K is denoted by F(n) = Pr(K < n), G(n) = 1—F(n). The distribution 
of service times is 1 — e~“*, and we are mainly interested in equilibrium. 

The decisions (to join or balk) form a sequence similar to those studied in the theory 
of runs, but without the restriction that the results arise from independent Bernoulli 
trials. 

It is not intuitively clear whether or not a long sequence of balks should predispose a 
new arrival to balk. On one hand such a sequence argues that the queue length has been 
reduced to some small value; on the other hand it should have been large to produce such 
a sequence. Furthermore, the reduction in queue length during a sequence of balks is 
produced by the service mechanism, and so a knowledge of the join-balk sequence is 
apparently insufficient to determine whether a new arrival will balk, since that decision 
is postulated to depend solely on queue length. 

The device which makes such an investigation possible is the use of the waiting-time 
distribution. Waiting time decreases equally with elapsed time, except when an arrival joins 
the queue. It is thus independent of the instants of service termination, and depends only 
on the join-balk sequence. Furthermore, its distribution can be expressed in terms of the 
queue length distribution and the constants A and yp. 

Let the system be said to be in the state H,,, n = 0,1, 2,... if at time ¢ there are n cus- 
tomers present, including the one if any then being served. Let 7,,75, ...,7,,... denote the 
points at which customers arrive, so that {7,,} is a Poisson process. Define random variables 
k(t) as follows: k(t) = n if at time t the system is in state Z,. Define a random variable w(t) 


as follows 
w(t) = 8 +8)+...+8yp, 


where 8, 8,,... are independently and identically distributed random variables with com- 
mon distribution function 1—e-#*, for x > 0.+ w(t) is called the waiting time at time ¢. 
Define random variables k,, w,, as follows: k,, = k(r,,—0), w, = w(T, — 0). Thus &,, is the 
queue length just before the nth Poisson point 7,, and w,, is the waiting time just before that 
point. 

Place P(n,t) = Pr (k(t) =n), Q™(n) = Pr(k 


=). 


m 


{ If k(t) > 1, 8, is the residual service time of the customer being served. If k(t) > 1, syy-1, ---> 81 
are the service times of the waiting customers. 


18-2 
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Then it can be shown that p(n) = lim Q™(n) = lim P(n,t) exists under the conditions of 
m—>o t>o 
QWB. Similarly, place 


(t,x) = Pr(w(t) <x), H™(x) = Pr(w,, < 2). 


Then it can be shown that H(x) = lim H™(x) = Le H (t,x) exists under the conditions of 


m—>o 


QWB. Following the notation of QWB further, we dette 
(8) = = p(n) 8", (8) = Up(n+ 1) F(n) 8”. 


The density function h(x) which corresponds to H(z) has the value (0) at the origin, since 
there is no waiting time when the queue is empty. In the opposite case, the waiting time is 
the sum of n negative exponential phases, where n is the number waiting or being served on 
arrival. Therefore 

Nyn—le—hx 


D(n) 


where j(x) is the Dirac delta function. If we write the incomplete gamma function 


h(x) = p(0) j (a) +" p(n), (1) 


y(n, y) = | “etetdt = D(n)—T(a,y), 


then it is easy to see that A(x) = p(0)+ > YP) y(n). (2) 
1 


It will also be useful to define a function similar to (2), but with the queue index advanced 
one unit 


J(x) = p+ A pin + 1) (3) 


Using an asterisk to denote Laplace transformations, we have 


hws) = (0) +E p(m)| 2" 





Gta ° 


as is well known (see, for example, Gaver, 1954). Also 
H*(s) = h*(s)/s, (5) 


omitting the term h(0+) because of the presence of j(x), as mentioned, for example, by 
Truxal (1955). The transformation of J(x} may be computed similarly, using the formula 


p(n+1) = pG(n—1)p(n) (p=Alp) 


from QWB; the result is J*(s) = i = 


, Lh*(s)— (0). (6) 
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2. CONDITIONAL DISTRIBUTIONS 


We now consider the queue length and waiting-time distributions, together with the 
generating functions and Laplace transformations associated with them, under certain 
specific conditions. These conditions will be indicated by subscripts, according to the 
following system: 

B as a subscript indicates the situation at the time of arrival of a customer who balks. 

J asa subscript indicates the situation at the time of arrival of a custumer who joins. 

N = 1,2,..., indicates the situation conditional on the arrival of a customer who is 
preceded by exactly N — 1 persons balking. That is, the time between this customer’s arrival 
and the preceding addition to the queue consists of N negative exponential phases. The 
subscript does not indicate whether the arrivai himself balks or joins. 

Each of these functions has its corresponding p(n,t), Q™(n), H(t,x) and H™(x), as well 
as limiting theorems analogous to those quoted in the preceding section. In all cases, we 
are interested only in the limiting (equilibrium) expressions and therefore pass directly from 
probabilistic definitions to equilibrium equations. 

It is shown in QWB that €(1) is the probability that an individual balks; this quantity 
will be abbreviated €. Then 

F(a) = Pr [wm < x|k(Tm +0) = k(7_—0) +1] 
== Pr (w,, < x) Pr [k(7,,+0) = k(7,,—0)+1|w,, < 2]. (7) 
The last factor may be evaluated as follows 
Pr [k(7,,+0) = k(7,,—0)+1|w,, < x] 


5 Pr [k(7,, +0) + k(7,, —0)+ 1|k(7,,, — 9) = n| Pr [k(7, — 9) = 2| Wp < x] 
n=0 


= > G(n—1) Pr [k(7,,, —0) = n|w,, < x). 
n=0 


In the limiting case this becomes 


ls y(n, ux) | p(0) 
Ha) FO" PO) Peay + He) 
a 2), 
p(x) 
Substituting this into (7), we have 
me. .8 8 
Using (5) with the J subscript, and (6), we obtain 
h5() = yl (0)— PO] (9) 
(4) is equivalent to n7(8) = h* ree (10) 
; aye _ (8)—p(0) ll 
and with (9) this gives n7(8) = int: (11) 
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Expanding into a series in s, we find that 





p(n+1) 
n) = w= 0,1, 2,....): 12 
Denoting the mean by m [and using the formula 1 — p(0) = p(1 — €) from QWBt] we have 
m 
a es oe 13 
= pl—é) — 


It is easy to see that m, is always positive. For p(1—&) is the effective traffic intensity p’ 
(as explained in QWB), and therefore 


2 ot ’ 
vem Kh dy 


m 

Using (11) higher moments of the conditional distribution can be obtained. 
The various quantities associated with the conditional distribution of individuals who 
balk can be obtained by arguments like those used above, or else by noting that, for any 
relevant function f, 


Ef; +(1—£) fp =f. (14) 
Some results are H,,(x) = =) ae : (15) 
_ m(s)_ (8) , p(9) 
9 p(s) = ¢ ~ pes * pes’ (16) 
pp(9) ™ 0, | 


a ® 


1 : 6 (17) 
pa(n) = -[ptm)—“pin+1)] (> 0),| 


: _m m— 1 ce p(0) 

and %-7-— i (18) 
Next we consider the situation in which an arrival is preceded by N —1 balks, saying 

nothing about whether or not this arrival himself balks, and find the probability distribution 

of queue length. First, suppose NV = 1. Let the waiting time of the arrival be w’, and the 

waiting time of the previous joiner be w. Then w’ = max (0,w+v—vw), where u and v are 

respectively theinterarrival and service times of persons who previously joined. We can write 


H,(x) = Pr(w+v—u < 2) 
whether or not 2 = 0; therefore 
H,(x) = Pr(w < x+y) 
where y = u—v, and for fixed y this is 
H,(x\y) = Hj(x+y) (19) 


since by hypothesis the distribution of w is H,(x). The distribution of y is easy to find, and 
turns out to be 


im (Ade (y > 0), 
fy) \AAev = (y < 0), 


+ This formula can also be used to show that H (oo) = 1. 
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where A = 1/(1+ ). Applying this to (19), 


0 2 
H,(z) = | AAev Hy(x-+y) dy + [ Ade” Hy (w-+y) dy. (20) 
ae J0 


However 


v0 


ev Hy (x+y) dy = | e-*e—-2) H(z) dz = eee Ff j2)de— |" eAe—-2) H(z) dz 
# 0 0 
xz 
= et Hya)-{ eAte—2) H(z) dz. 
0 
Substituting this for the second integral in (20), taking the Laplace transform and using 
(5), we obtain 


A s n(A)—p(0 s A 
hi(e) = ,~ 21806) — PO] +, 7 my ot 1 ag*)—PO] (<8 <A). 


(21) 
It will be noticed that since A < 1, 7(A) is convergent. Replacing s by u(1—s)/s, we have 
¥)- 9), 8. WA An — 9) 


9,(s) = ial iF acm (0<A<s< 1). (22) 
Expanding this expression gives 
A)—p(0 
p= 1)=20, 
(1 + yt «© (23) 
p(n) =F & Alpi) (n> 0). 
j=n 


Formulae (23) are consistent with the classical (no balking) case. For, if € be set equal to 
zero, then p(n) = (1—p) p”, and p,(n) computed from (23) turns out also to have that value, 
as would be expected. 

For values of N > 1, this method of waiting times must be replaced by another argument, 
based on the joint distribution of N and queue length, n. It appears that neither system 
will yield results in both the cases N = 1 and N > 1. 

We denote the joint probability of a queue length of n and N — 1 previous balkers at the 
time of a customer’s arrival by a(n, NV), n = 0,1,..., N = 1,2,..., and the distribution of 
N alone by a7(N) = ¥\a(n, N). Thus 

” 


a(n, N) = py(n)7(N). (24) 


Various relationships between the 7(n, NV) can be found by setting up differential difference 
equations as in Feller (1950) or QWB, with the additional complication that the pro- 
babilities involve two variables. The initial values of n and N must be dealt with separately, 
and we have therefore four cases: Case I, n = 0, N = 1; Case II, n = 0, N > 1; Case ITI, 
N = 1,n > 0;Case IV,” > 0, N > 1. Ineach case there will be terms arising from the three 
possibilities: no transition, one arrival, one departure, if we omit to mention terms of 
o(dt). The following discussion indicates briefly how each of the four equations is obtained; 
the time argument, which is almost immediately removed by assuming equilibrium, is 
momentarily indicated by a subscript. 
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Case I (N = 1,n=0) 


no transition (1—Adt) 7,(0, 1), 

arrival impossible, 

departure potn(1, 1) (1—Adt) 
leading to the equation par(1,1)—An(0, 1) = 0. (25) 
Case II (n = 0, N > 1) 

no transition (1—Adt) 7,(0, NV), 

arrival impossible, 

departure pot(l —Adt)n,(1, N) 
leading to the equation pn(1, N)—An(0, N) = 0. (26) 
Case III (n > 0, N = 1) 

no transition (1 —Adt) (1 — dt) m,(n, 1), 

arrival A dt(1 — wdt) G(n — 2) p(n—1) 
since the arrival must join. 

Departure pwdt(1 —Adt)m,(n+4+ 1, 1) 
leading to the equation 

pr(n+1,1)+AG(n—2) p(n—1)—(A+ yp) n(n, 1) = 0. (27) 

Case IV (N > 1, n > 0) 

no transition (1—Adt) (1—pdt)a,(n, N), 

arrival Adt(1 — dt) F(n—1)m,(n, N —1) 


since the arrival must balk. 
Departure pot(1—Adt)a(n+1,N) 
leading to the equation 
pun(n+1,N)+AF(n—1)a(n, N—1)—(A+ yp) n(n, N) = 0. (28) 
The bivariate generating functions will be defined similarly to the univariate ones 
n(s, 8S) = LUn(n, VN) s"8%, } (29) 
&(s, S) = LEn(n+ 1, N) F(n) 88%. 


Multiplying equations (25)-(28) by appropriate powers of s and S and summing gives the 
bivariate generating function equation 


wS{n(s) — pO) + AaSe(e, 8)+m(8,8)| oh Ee 1} +(u-) ¥ 71(0,N)S¥=0. (30) 
N=1 


If we set s = lor S = 1 in (30), we find relations equivalent to QWB (7); with both s = S = 1, 
we obtain £(1,1) = é. 

A more useful (conditional) generating function equation can be obtained by using (24) 
in equations (26) and (28), for N > 1. Multiplying by s only, and summing on 7 only, gives 


As?n(N — 1) €y-1(8)—[(A+ 4) 8— 1] m(N) gy(s) — (1 —8) 7(0, N) = 0. (31) 
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The expressions £y(1) are by no means equal to €; they will be abbreviated £,. When we 
set s = 1 in (31), we find that the relationship between the probabilities 7(N) and the €, 
is exactly the same as that found in QWB to exist between the p(n) and the pG(n—1), 
making allowance for the fact that the domain of N begins with unity rather than zero. 


Namely, mN+1)=€éy7(N) (N>1). (32) 
For N = 1, the equation which completes the set (31) is 

(A —s) (1) + (1—s)7(0, 1) + A[y(s)—p(0)] = 0 (33) 
and with s = 1, this yields ml)=1-é (34) 


which provides an initial value for the set (32). In fact, defining 


Cy=1, Cy= “Tr §&; (N>1), (35) 
i=1 
we can write m(N) = (1-€)Cy, (36) 


a result perfectly analogous to QWB(3). Thus the bivariate probabilities m(n, N) have 
essentially the same type of marginal total distributions. 

The 7(N) are known once the €, are known. To discover these latter probabilities, we 
first set s = A in equation (31) 


Am(N —1) €y_4(A) = (0, N) = py(0)m(N) = Ey_y7(N — 1) py(0), (37) 
and therefore Py(0) = sya) (NV > 1). (38) 
N-1 


Putting the value for 7(0, V) given by (37) back into equation (31), we are able to express 
9 y(8) in terms of various values of £y_,(s), namely 


(1 — 8) A*Ey_a(A) — As*ya(8) 
(A—s8)Ey-1 
When s < A, this can be expanded in positive powers of s, and the values of py(n) 


abstracted from the series. In this way the value given in equation (38) is continued as 
follows 


qn(8) = (39) 


n—1 n—1 
Py(n) = are Agy—4(A) — x F(i—1)py_,(i) A‘) (n> 1, N > 1). (40) 
Furthermore, since ty = Spy(n) F(n—1) 
1 
and (1/s) [n(s) — px(0)] = = Py(n) gr-l, 


values of £, can be obtained by replacing s” by F'(n) in an expansion of (1/s) [97y(s) —py(0)] 
in positive powers of s. When these are carried out, the following recursive formula is 
obtained 


a ; oe) 


i (pléy-1){Aéy-a(A) [1+ SE Fi)(1+p)'|— SS FW py FG-D (+p). (41) 


i=1 i=1 j=1 
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3. INTERJOINING GAP DISTRIBUTION 


In the preceding section we have found a method for calculation of 7(NV), the probability 
that the time gap between arrival (whether joining or not) and preceding joiner will be 
ANgN-1 e-Ax 


ru) (42) 


Therefore the density function of times between arrivals and preceding joiners is 


x ANgN-1 e— Ax 
a(x) = PF aN) -— rv) 


In this section we find corresponding quantities for gaps between a joiner and the preceding 
joiner. 

The reason for studying interjoining gap distributions can be simply stated. In actual 
observation of a queue with balking, it could happen that balkers would not be observed. 
For example, if the queue occurred at a heavily congested road intersection, the drivers 
who choose to ‘go around the block’ rather than wait would very likely adopt this plan at 
some distance from the intersection, and so be indistinguishable from ordinary traffic 
stream attrition. In such a case the problem of estimating the magnitude or quality of 
balking (which might be called seeking hidden demand for service) would have to be solved 
by reference to joiners only. Specifically, the observed interjoining gap distribution would 
be compared with the negative exponential on one hand, and with the distribution which 
we obtain in this section on the other. 

Let the functions ¢(s) and y(s) be defined by 


(43) 


(s) = m(1) +. 8m(2) + 8277(3) + ..., (44) 
y(s) = m(1) +.87(2) + “ n(3)+.... (45) 

Then there is a simple relationship 
a(x) = Ae** (Az) (46) 


between the y function and the gap density. Also, it is easy to express y in terms of ¢. For, 
with a garama-type integral substituted for the factorials in (44), we have 


ols) = |" ety, (47) 


a formula mentioned by Riordan (1958, p. 29). Replacing s by 1/s and t by st gives 


(1/8) (1/8) = i. v(t) dt. 


Therefore y is the inverse Laplace transform of (1/s) 4(1/s). 

Now we consider the interjoining gap distribution, and define similar quantities. Let 
the probability that an interjoining gap consists of N negative exponential phases be y(V), 
and let b(~) be the interjoining gap density function which we seek. Then, defining 


@(s) = y(1) + sy(2)+s*y(3)+..., (48) 


2 
¥(s) = (1) +8y(2) +578) +... (49) 
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we know already that b(~) = Ae** (Az) (50) 
and that ‘’(s) is the inverse Laplace transform of 

(1/s) ®(1/s) = Zy(N)s-¥—. (51) 


Since both ¢ and y are known in principle from the preceding section 6(x) will be known once 
(s) is expressed in terms of ¢(s). The required formula is 


_ (8-1) ¢(s) 1 
= ae ¢: (52) 
which we shall now prove. 


Consider a long sequence of mixed J and B symbols, and let 


Jy = total number of J runs of length N, 

By = total number of B runs of length JV, 

Il = total number of times a symbol is separated from the next preceding / by exactly 
N—1 symbols, 

['y = total number of times a J is separated from the next preceding J by exactly N —1 
symbols. 
Thent m(N) = ae , y(N) By 


— ly ° Jy Le Tes 
TI bi x=By 


a ea fee 


by 


represent the relative frequencies. Note that XJ, = UBy. We shall use the unorthodox 
notation 7, Y, ), 6 for the means of these distributions to avoid the introduction of four 
additional letters. It is easy to see that 


1 5 
a 3 

Kach run of N J’s will correspond to N single 7 gaps and N — 1 single y gaps. Therefore 
Il, = UNJy and r, = > (N —- 1) Jy. (54) 

2 
On the other hand, a run of N B’s produces one double 7 gap, one triple 7 gap, ..., one 
(N + 1)-fold 7 gap; but only one (N + 1)-fold y gap. Hence 
Ily = >Y By, ry = By (N = 2, 3, Seat (55) 
N+1 


Summing the I1,, we have 


xIl N = uNdy + =NB, = Judy + bIBy 
7 


= n(1) E11y +-50(2) 211y, 

, Ped 56 
or b= 72) (56) 
Also, since Lily = (7 +5) UBy = (9 +5) a(2) Dy, 
we have 9 = 7(1)/7(2). (57) 
Summing the [',, Ly = DVNIy—-DIytUBy = a(1) Uy; (58) 

2 2 
and similarly ly = By_, = Ily—Ty,,. = [a(N)—a(NV + 1) ZT y. (59) 


+ All summations in this section go to infinity; those without lower index begin at one. 
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Therefore y(N) = a al so hel ' (60) 
m(1) 

and since XINTy = UTly = yr y+a(1)VXM1y 

we have also mi) = 1/y=1-€. (61) 


Forming generating functions from (60) and using (61) with (53), it is now easy to deduce 
(52). The distribution of lengths of runs of balks is very similar to (60) 


_ AN+1). . 
“pe 
Hence 6 =Jj 1-¢° (63) 


The mean number of phases in a 7 gap is connected in a very simple way with the variance 
of the number of phases in a y gap, as may be seen if (60) is multiplied by N? and summed. 
The result is 


(1— 2) var (y) += = 27-1. (64) 


The preceding results are of course valid for any sequence of symbols of two sorts, whether 


arising from a queue or not, provided the proper construction is placed on the quantities 
involved. An example based on the following sequence may be useful: 


BJJJBBBJBJIBJBBJJJIBIJJTIBIJSIITTII BIJTII IT BBIIBIBBITIS 


N 1 2 3 4 5 6 7 8 
J 4 1 1 0 0 

j 4/11 1/11 1/11 3/11 1/11 0 0 1/11 
B 7 3 1 - a _ 
b 7/11 3/11 1/11 es aie — se _ 
Il 34 11 4 1 et _ 
n 0-68 0-22 0-08 0-02 _ — — _ 
r 23 7 3 1 phe - = 
y 0-6764 0-2059 0-0882 0-0294 me a de — 


J = 3-0909, 6 = 1-4545, # = 1-44, Y = 1-4704, £ = 0-32, 1/(1—£) = 1-4704. 


4. POISSON BALKING 


In this section we present some numerical results based on a simulated queue with 
balking, in which 500 arrivals with A = 1, ~ = 2, use a Poisson balking rule with mean value 
10. That is y(n + 1, 10) 


OO) = “Rint 1) 


(65) 


Table 1 shows the observed values for arrivals and Table 2 for joiners, together with fitted 
distributions (i) for geometric probabilities 


(1-Q)QN (N =0,1,...), (66) 
(ii) for negative binomial probabilities (cf. Kendall, 1943, p. 125) 
| C | bs N-1 


oxi v )(o+1ys (N = 0,1,...) (67) 


en 
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and (iii) for Borel probabilities (cf. Borel, 1942, Haight & Breuer, 1960) 


eat N gN-1 
a CTEM ON = 1,2,...). j 
(wi? a (N = 1,2...) (68) 
The first two of these must refer to the number of previous balkers, while (68) refers directly 
to the number of exponential phases. We shall use a dash to indicate that the index is thus 
retarded one unit: 7’(N) = 7(N +1), y'(N) = y(N +1). 


Table 1. Observed and theoretical distributions of number of 
negative exponential phases in an interarrival gap 


m(N) m’(N) m’(N) m(N) 

N observed geometric negative binomial Borel 
1 0-50928 0-45118 0-50016 0-57695 
2 -21649 *24762 *21570 -18308 
3 *10515 -13590 -11613 -08714 
+ -05979 -07458 -06667 -04916 
5 -03918 -04093 -03946 -03047 
6 0-02474 0-02246 0-02378 0-02005 
7 -01856 -01233 “01450 -01375 
8 -01031 -00677 “00892 -00972 
9 -00825 -00371 -00552 -00703 
10 -00412 -00204 -00343 -00519 
>10 -00412 0-0248 “00573 -01746 

x? a 17-20 1-92 16-01 
Table 2. Observed and theoretical distributions of number of 
negative exponential phases in an interjoining gap 

n(N) n’(N) n’(N) n(N) 

N observed geometric negative binomial Borel 
1 0-57490 0-50928 0-58869 0-61263 
2 721862 -24991 -18943 -18390 
3 -08907 +12264 -09356 -08281 
4 -04049 -06018 -05158 -04419 
5 -02834 *02953 -03029 -02591 
6 0-01215 0-01449 0-01786 0-01613 
7 ‘01619 ‘00711 ‘01087 -01046 
8 -00405 -00349 ‘00671 -00700 
9 -00809 ‘00171 ‘00418 -00479 
10 -00405 “00084 -00262 -00334 
>10 -00405 -00082 -00421 -00884 

= — 10-39 3-92 6-21 


The geometric and Borel distributions have been fitted by equating means (which is 
equivalent to maximum likelihood in these cases) and the negative binomial according to 
the equations given by Kendall. 

The geometric distribution gives a very bad fit, and this refutes any suggestion that 
balking occurs at random in this case (cf. Feller, 1950, p. 219). Furthermore, from equation 
(52) or (60), if one of these distributions were geometric, the other would have to be 
geometric also. 
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The negative binomial distribution might be justified in this problem as a ‘contagious’ 
distribution, but I have not been able to establish a connexion. One difficulty seems to be 
that the parameters P and C do not have any intuitively simple relationship with important 
queue-theoretic quantities such as €. 

In the Borel case, this difficulty does not exist, for a = € exactly, and therefore estimation 
of the Borel parameter is equivalent to estimation of the probability of balking. Further- 
more, the interpretation of the Borel distribution as the probability that N persons will pass 
through a queue before it first vanishes, beginning with one person (random arrival and 
regular service) seems to have some vague connexion with the problem at hand. 


I wish to express my gratitude to the referee for his elaborate and valuable comments on 
earlier versions of this paper, which exposed a number of serious errors. 
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On comparing different tests of the same hypothesis* 


By H. A. DAVID anp CARMEN A. PEREZ 


Virginia Polytechnic Institute 


1. INTRODUCTION 


Suppose that the standard test of the null hypothesis H,:@ = 0, is based on the statistic v. 
In certain circumstances we may prefer a test involving some other statistics v’, be it because 
such a test is more easily and quickly carried out or because it is more robust (i.e. insensitive 
to assumptions not under test). It is customary to compare the long-run individual per- 
formances of the two tests by means of their power functions or related criteria. While this 
kind of comparison is invaluable the following question also appears to us of interest. To what 
extent, in the long run, does the quick test give the same verdict as the standard test when 
both are applied to the same sets of data? In special cases this question has been studied by 
empirical methods. Thus agreement between the standard deviation s and the range w in 
a series of small samples of real data has been examined by Pearson & Haines (1935) who 
plotted w against s in a control chart situation. With the help of the known standard 
deviation o they were able to insert on their diagrams a grid of several upper- and lower- 
percentage points of both wand sso thatthe corresponding degrees of significance attained by 
any sample and the agreement in this respect could be seen oninspection. Asimilarapproach, 
but based on experimental sampling from normal populations, was used by Eisenhart & 
Swed (1940) to compare two possible tests of the homogeneity of several estimates of vari- 
ance. In the null case they found considerable disagreement at the 5 °% level of significance. 

More recently Cox (1956) has discussed some general aspects of this problem. We now 
restate and add to some of his arguments: (a) The case for a particular quick test is 
strengthened if it is known that it will nearly always lead to the same action as the standard 
test. (b) Quick tests are often used in preliminary or spot analyses. It seems highly desirable 
that the conclusions so reached should not be seriously upset if a fuller analysis is carried out. 
The quick test should inspire confidence in this respect even if it will not be followed up at all. 
(c) The method of data collection or experimentation may lend itself to a particularly 
advantageous use of quick tests; indeed, the experimental approach may be modified for 
this reason. To be specific let us consider a life test on items with a normal distribution, 
N(@, 0), of lives. The test may be stopped as soon as just over half the items in it have failed. 
If o? is assumed known a very simple test on 9 may be based on the sample median. One 
could, of course, improve the analysis by using all the available observations and not only 
the median. More fundamentally, the experimental method hinges on the fact that it allows 
a quick decision to be reached. Confidence in the reliability of this approach is presumably 
based on the knowledge that the median leads to a reasonably powerful test, but also on the 
supposition that the conclusion reached with the censored test would generally be confirmed 
were the test in fact run to completion. A similar point could be made in comparing the 
paired t-test and the sign test: not only does the sign test rest on fewer assumptions, it also 
allows a simplification of experimental technique. 


* Research supported, in part, by Office of Ordnance Research, U.S. Army. 
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So far we have confined ourselves to consideration of a single quick test. If a competing 
test statistic v” is also available it would seem reasonable to prefer the test based on v’ to that 
using v” if the former agrees more closely with the standard test, other things (e.g. power) 
being roughly equal. When both null and alternative hypotheses are simple this situation is 
illustrated schematically in Fig. 1 where the rejection regions are the sides of the boundaries 
shown which do not contain the origin. 

In his article Cox studied the regression of v on v’ in a special case and could then gauge the 
approximate degree of significance of v given the level of significance of v’. To do this he had 
to make some assumption about the prior distribution of 6 which he took to be uniform. 
It is the purpose of the present paper to propose two measures of the degree of agreement 
between standard and quick tests which under suitable conditions do not have to rely on the 





x 








Fig. 1. Illustrating that of two equally powerful tests based on v’, v” the former provides 
better agreement with the best test based on v; ©, represents the probability density 
F (%, | Hy), O, represents the probability density f(#,, 7,!H),). 


use of prior probabilities. These conditions hold in a number of important situations and 
require the existence of a complete sufficient statistic for 0 if H, is simple and for 6 as well as 
other unknown parameters if H, is composite (see e.g. Lehmann & Scheffé, 1950). 

The two measures will be introduced by means of a simple example and then applied to 
give comparisons of: 

(i) tests of location in a normal population with known variance; 

(ii) the use of standard deviation, range and mean deviation in tests of dispersion for a 
normal parent; 

(iii) the paired t-test and the sign test in the normal case. 

It will also be shown that in large samples the two measures can be related to the asymp- 
totic efficiencies (when these exist) of the statistics used in the quick tests or to the asymptotic 
relative efficiencies of these tests. A general statement of the two approaches introduced is 
given in §5. 

2. TESTS OF LOCATION 


We consider the following very simple situation: x, 2, ..., 2, is arandom sample from an 
N(y, 1) population. To test Hy: « = 0 against H,:~ > 0. Here the uniformly most powerful 


test is, of course, to reject Hy when 
u, =Z./n > u,, 
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where wu, is the upper a significance point of a unit normal deviate wu. A possible quick test 

is to use only the first k (< n) observations in the sample and to reject H, if, with obvious 

notation, tt, = B, Jk > te. 

One natural way of measuring the degree of agreement of the two tests is to obtain 
Pr(u, > u,| U2 > Uz), 


the conditional probability of establishing significance at level « with w,, given that the 
quick test wu. has led to significance at that level. Now this probability is readily evaluated 
on H, or for any specified value of ~, but we would like to know its value for ~ unknown. 
This can only be done if w is assumed to have some prior distribution. 

















05 06 0:7 08 09 10 


Fig. 2. P = Pr (wu, > 1-645|u, = 2-326) as a function of p, the correlation coefficient 
of the unit normal variates w,, Uo. 


The merits of u, and wu, may, however, be compared differently. We propose two quite 
general approaches and illustrate them on the present example. Imagine a series of samples 
of size n each on the borderline of significance when w, is the test-statistic. The true value 
of wis unknown and may be different from sample to sample. How would the quick test have 
worked on these samples? 

(a) Consider the probability P of establishing significance with u, at level £, given that u, 
is just significant at level a, viz. 


P = Pr(uz > ug|% = U,). 


Note that P does not depend on yp since uw, is sufficient for w. Since P < 4 fora = f it is most 
meaningful to choose # > a (i.e. us < uz). We have 


P = Pr[u > (ug—pu,)/V(1—p*)], (1) 


where p = ,/(k/n). A slightly different possibility is to find w, (and hence f) such that P has 
a specified value. 
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Equation (1) will, of course, continue to hold when u, is any unit normal deviate having 
correlation coefficient p with u,. In Fig. 2, P is plotted as a function of p for a = 0-01, 
B = 0-05. 

(b) An alternative approach arises from the question: Given 1, is just significant at level 
« how significant is the expected value of u, calculated from the same sample? Since 

E(u | Uy = U,) = Puy, 
the required level of significance is 
y = Pr(u, > pu,). (2) 





013 





0:01 
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Fig. 3. Equivalent Type I error y of quick test based on uw, corresponding to significance level « 
of best test based on u,: y = Pr(u, > pu,) 


It is clear that y > a. Weshall term y the equivalent T'ype I error of the quick test based on 1. 
Fig. 3 shows y as a function of p for « = 0-05 and 0-01. The measure y is further discussed 
in §5. 
Generalizations 

Consider the above situation but with %,, replaced by any unbiased estimator m of 7, such 
as the median, mid-point (mid-range), or some linear function of the order statistics. P may 
new be written as P =Pr(m > m,|%=2%,), (Hq = Ugln). 
As is well known, m—Z has a distribution free of « and is statistically independent of %, 
a result which follows most readily from the sufficiency and completeness of % for ~ (Basu, 
188). Hance P = Pr(m—z > my—2|z = &,) 


= Pr(m—% > m,—7%,). 
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This is liable to be rather awkward to evaluate and the second approach is somewhat 
simpler since 


Hence the ‘equivalent Type I error’ of m is 
y = Pr(m > 2,). 


It is of interest to examine the case where m is asymptotically normal with asymptotic 
efficiency £,,. In this situation Figs. 2 and 3 can be used at once to evaluate the large sample 
values of Pandy by using the relation p = ./E,, (of course, this relation is true in finite samples 
also, with Z,, taken to be 1/(n var m), but is not easily interpreted unless the joint distribution 
of and m is bivariate normal). As an illustration take m to be the median. Then E,, = 2/7 
and p = 0-798 which from Fig. 2 gives P as low as 0-64 and from Fig. 3 yields y = 0-094, 


0-031 for « = 0-05, 0-01, respectively. The mid-point is not asymptotically normal (Gumbel, 
1958, p. 311). 


3. TESTS OF DISPERSION 


Given a random sample 2, 2, ...,#,, from a N(u, 0) population, suppose it is required to 
test the null hypothesis H,:o = 1, with ~ unknown. We shall apply the two approaches 
introduced above to compare three well-known tests of Hy, namely, tests based on the sample 
standard deviation s = ,/[X(x;—%)?/(n —1)], the range w, and the mean deviation 


When the alternative to H, is H,:0 > 1 the three tests consist in rejecting H, when, 
respectively, 
8S>8,, w>w, d>d,. 


The first of these tests would, of course, be made by referring &(x;—%)* to tables of the 
percentage points of y?. Percentage points of w and d are conveniently given in Biometrika 
Tables for Statisticians, 1 (Tables 22, 21). It may be mentioned that in this case also 
p(s,w) = JE, and p(s,d) = ./E,. These correlation coefficients have been tabulated by 
Hartley (1955) for m = 2(1)20. We have 


WwW Ws 
P,, = Pr(w > w,|s = 8.) = Pr(¥ > —|8 = sa) 


\ 


=Pr ( a =) 
an = 
since w/s is independent of s, a result used by David et al. (1954) to find percentage points of 
this ratio of the range to the standard deviation calculated from the same sample.* For 
n > 10, P,, can be evaluated by a Pearson Type approximation to w/s. For n = 10,a = 0-01, 
8 = 0-05 we find P,, = 0-809, and by exactly the same approach P,; = 0-905. The corre- 
sponding correlation coefficients are 0-954 and 0-922. It is interesting to note that for n = 3 
(and the same «,£) both P,, and P, are unity. This follows from the fact that both w/s 

* The result can be proved by elementary methods but follows most readily from Basu’s (1955) 
work referred to in §2. 
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and d/s are bounded, with lower bounds respectively greater than w,/s, and d,/s,. (The lower 
bounds are /3 and 3 while w,/s, = 1-542 and d,/s, = 0-595.) 
The equivalent Type I errors y,,, yz are readily obtained; thus 


w 
8) = 6 (Fs|s=s,) 


a6 (Ts = s.) 
8 


8,6 (w/s) 
= 8, 6(w)/E(s).* 


The second step is justified by the properties of conditional expectations (see e.g. Kolmo- 
gorov, 1950, p. 56), and the last step is a consequence of the independence of w/s and s. 


We have, therefore, y_. = Priw > «Salley 


which may be evaluated from tables of the probability integral of w (Table 23 of Biometrika 
Tables for Statisticians, 1). Likewise 


Ya = Pr[d > 8,6(d)/é(s)] 


can be obtained from tables of the probability integral of d (Godwin & Hartley, 1945). In 
Table 1 we give, for n < 10 and a = 0-05, 0-01 the values of y,, and y, together with the 
corresponding correlation coefficients taken from Hartley’s (1955) paper. It will be seen 
that on all counts w is superior to d for n = 4, 5 but inferior for n > 6. The correlation 
coefficient agrees remarkably well with y as an indicator of the relative merits of w and d. 


The results for n = 00 follow from the asymptotic normality of d which has asymptotic 
efficiency 1/(7— 2). 


E(w|s 


Il 


Table 1. Values of the ‘equivalent Type I errors’ y,,, Yq, of tests based on the range w and the 
mean deviation d corresponding to Type I error a in standard (x?) test; together with the 
correlation coefficients p(s, w), p(s, d) 


\s 0-05 0-01 0-05 0-01 
n NM Vw Yw p(w, 8) Ya Ya p(d, 8) 
3 0-0508 0-0105 0-9959 0-0508 0-0105 0-9959 
4 -0526 ‘0114 -9875 -0536 -0122 -9818 
5 -0548 -0125 ‘9771 *0557 -0130 -9726 
6 ‘0571 -0136 -9660 -0569 -0136 -9664 
7 -0594 ‘0149 *9546 -0578 -0139 -9620 
8 -0617 ‘0161 *9434 -0585 ‘0141 -9586 
9 ‘0641 ‘0174 *9324 -0589 -0143 -9561 
10 -0664 ‘0186 -9219 -0593 -0145 *9540 
9) _ —- —_ -0618 -0147 *9359 


4. THE SIGN TEST AND THE (¢-TEST 


When a random sample x,, 2%», ...,2, from an N(y, 0) population is available and o? is 
unknown, the uniformly most powerful test of H): ~ = 0 against H,: > 0 is to reject H, if 


t = Z,/n/s > t,, 


* This result proves incidentally that the regression of w on s is linear. A similar argument shows 
that the variance of w given s is proportional to s*. 
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where t, is the upper a significance point of a t-variate with n—1 degrees of freedom. To 
apply the sign test to this situation the number r of positive 2’s is first determined. On H, 
(and in fact under a much more general null hypothesis) r is a binomial variate with para- 
meters (”, 4) so that a test of significance is easily made. 


We begin by obtaining the conditional probability 7, that x, > 0, given that the t-test is 


just significant at level «. mr, = Pr(a, > 0|t = t,) 


= Pr(z,/s > 0|t = t,) 


= Pr (2742 > 0|t=t). 
8 8s 


The distribution of (x, —%)/s is clearly free of ~ and o. Therefore (x, — Z)/s is independent of 
any function of the complete sufficient statistic (%,s), and in particular of t. It follows that 


: & 
vn} 
This is then the conditional probability of a ‘success’ on the first trial and does not depend 


on 4. The v trials are evidently not independent so that the probability of r successes out of 


n is generally difficult to evaluate. However, the conditional probability of n straight 
successes can be expressed as 


P’ =Pr (fee? > =) =Pr (Ge < *) : 
8 Jn 8 Jn 





i, = Pr( 








The ratio (max. — Z)/s was first studied by Pearson & Chandra Sekar (1936). With the help 
of further recent work by Borenius (1958) we obtain the following results: 





Significance 
level of cr A —~ 
n sign test a = 0-05 a= 0-01 
4 1/16 0-359 1 
5 1/32 0-074 0-809 
6 1/64 0-055 0-417 


Our second approach is again easier to apply. After some manipulation we have 


n—2 } 
- 5 _1)2—# 
T. Prt < te fi 12 al (n—1)?—-# > 0, 


=1 (n—1)2-# <0, 


(3) 


where ¢ (but not t,) is based on n— 2 degrees of freedom. Hence the equivalent Type I error 
of the sign test is y= Pre > an), (4) 
where r is binomial (”, 4); or with a normal approximation to r 

y = Pr[u > /n(27,—1)]. (5) 


Since, in general, nz, is not integral we have thought it most appropriate to evaluate y in 
(4) from the histogram representation of the binomial distribution; i.e. denoting the integral 
part of n7,+4 by I, we take 


y = Pr(r > J+1)+(n7,+4-—L)Pr(r = J). 
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Table 2 gives y for various values of ~« and v = n—2. Due to the discreteness of the binomial 
distribution some irregularities in the variation of y with v are inevitable. 


Table 2. Equivalent Type I error y of the sign test corresponding to the paired t-test in 
samples of n with Type I error a 


Noa 
y= n-2\ 0-05 0-025 0-01 0-005 
2 0-0582 0-0312 0-0312 0-0312 
3 0918 -0308 0171 0156 
4 0892 0522 0145 0103 
5 0912 0501 0240 .0077 
6 .0971 0518 0245 0142 
7 0872 0570 0211 0138 
8 0972 0511 .0278 0119 
9 0945 0574 0262 0161 
10 0939 0568 0264 0152 
12 0896 0587 0263 0171 
15 0956 0577 0271 0174 
20 0964 0576 0281 0182 
30 0950 0565 0301 .0187 
60 0950 0588 0308 0193 
00 0947 0589 0317 0199 


Relation to asymptotic relative efficiency (A.R.E.) 


Stuart (1954) has pointed out that the asymptotic relative efficiency (in the sense of 
Pitman) of two consistent tests V, V’ of the same null hypothesis concerning the parameter 0 
is equal to the ratio of the asymptotic variances of two consistent estimators v, v' of 0 on 
which these tests can be based. Suppose now that v is sufficient for 0. Then it will be asympto- 
tically efficient (provided an asymptotically efficient estimator of @ exists). In this case 
A.R.E. of V’ relative to V will be equal to the asymptotic efficiency, say HZ’, of v’. Asymptoti- 
cally, if v and v’ are jointly normal they will have correlation coefficient p = ./Z’. Thus we 
can apply the results and graphs of §2 to convert a known 4.R.£. into values of P or y. 
Conversely, knowing P or y for two asymptotically normal statistics, one of which is 
sufficient, we can deduce their correlation coefficient p and hence the .8.£. of the inefficient 
test. For example, it can be shown that as n — oo, equation (4) becomes 


y = Pr[w > u,(2/7)) 


so that p = ,/(2/7) on comparison with equation (2). This in turn yields the known A.R.£. of 
the sign test for a normal parent, viz. 2/7. 


5. SUMMARY AND DISCUSSION 


We now restate the problem under consideration in its general form: Given two or more 
tests V, V’, V", ... ofthe same hypothesis Hy: 0 = 0) against the alternative H,:0 > 0, to find 
measures of the degree to which the tests lead to the same conclusion. Suppose that 
V,V’, V", ... are based respectively on the statistics v, v’, v", ... which have critical upper 


, 


« significance points v,, v,,, vj, .... One measure of the degree of agreement of v and v’ is 


P=Pr(v' >v;|v=,) (2 >). (6) 
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We regard P as useful if a statistic v can be found such that P does not depend on 0, which 
will be so if the conditional distribution of v’ given v is free of 0. In this situation a second 
measure is the ‘equivalent Type I error’ y of V’, relative to V, defined by 


y = Pr[v’ > &(v' |v = »,)]. (7) 


The following way of looking at y may be of interest. The conditional distribution 
f(v’ |v = v,) has, for a reasonable test-statistic v’, considerably smaller variance than the 
unconditional null distribution f(v’). Fig. 4 shows the two distributions in a typical case 
(with v’ roughly the range in normal samples of 10 and v the corresponding standard 
deviation). For samples with v = v, we may expect large values of v’. Suppose that for one 
of these samples v’ = vj. This corresponds to a level of significance on the quick test of 
Pr(v’ > v). As an average measure of this level it is convenient to take y as in (7). (Other 
averages might be used but, in view of the relatively smali variance of f(v’|v = v,), would 
not lead to very different results.) 






é (v'|\v= v,) 


fiv'lv=v,) 





= 


BA 








Fig. 4. Shaded area to right of A represents critical region for test based on v’; shaded area to 
right of B represents equivalent Type I error y of the test. 


It will be seen that the statistic v plays a special role in these measures. For H, a simple 
hypothesis, P and y are free of 0 if v is a sufficient statistic for 0. This case is illustrated in 
§2. When H, is composite, suppose that the unspecified parameter (possibly vector-valued) 
is ¢. If a statistic (v, y) exists which is sufficient for (0, ¢) then 


Pr(v' > v,|v,y) 


is independent of 0. If, in addition, y is statistically independent of v’ then P and y will not 
depend on 0. The tests in §3 fall into this category, with v = sand y = &. It is easy to see that 
tests V", V”, ... may be compared with V in the same way. Also indirect comparisons of V’ 
and V” may be made with the help of V by evaluating P and y for both V’ and V”. In 
§4, H, is composite and it is possible to find a satisfactory statistic v (viz. t) without the 
existence of y. 
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It seems to us that P and y are intuitively reasonable measures of agreement but an 
alternative interpretation is possible. Pr(v’ > v% |v) is, in all but artificial cases, a monotonic 
function of v, which we may without loss of generality take to be non-decreasing. Thus P may 
be interpreted as a lower bound of 


Pr(v’ > v4 |v > v,), 
although this probability depends on 0. Likewise y is a lower bound of 
Pr[v’ > &(v' |v > v,)). 


For the sake of simplicity we have restricted our treatment to the case of one-sided tests, 
but this is not a necessary limitation. When the alternative hypothesis is two-sided (6) can be 
replaced by P = 3[Pr(v’ > vy,|v = o,)+Pr(v’ < vi_ye|v = 04-42). 

If, in particular, both v and v’ have symmetrical distributions (the case of ‘double 
symmetry’) this reduces to 

P=Pr(v' > Vy ~|v = V4q), (8) 


so that P is the same as for the corresponding one-sided test with both a and / halved. 
Likewise, y in (7) may be replaced by 


y = Pri[v’ > &(v' |v = y%,)] + Pr[v’ < &(v’ |v = v,_4,)], 
which in the case of double symmetry becomes 
y = 2Pr[v’ > &(v'|v = »,)]. (9) 


By means of (8) and (9) the results for one-sided tests obtained in §§2 and 4 are easily con- 
verted into results for two-sided tests. 


Weare very grateful to Prof. E.S. Pearson for a number of valuable suggestions, including 
Fig. 1, regarding the presentation of this paper. 
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The performance of some correlation coefficients for a general 
bivariate distribution 


By D. J. G. FARLIE 
Research Laboratories of The General Electric Company Limited, Wembley, England 


1, INTRODUCTION 

Association between two variables has in the past been measured or tested by several 

coefficients, among them 
(i) Product moment correlation coefficient. 
(ii) Spearman’s rank correlation coefficient. 

(iii) Kendall’s alternative rank coefficient 7. 

(iv) Probability of concordance. 

The efficiency of each of these coefficients in detecting association between two variables 
is not in general known, but it is known that none is uniformly better than the others. 
Conjectures have been made that coefficients (ii) and (iii) behave in much the same way 
for reasonable distributions, but as pointed out by Daniels (1950) a sample ranking can be 
considered for which (ii) and (iii) have very different values. If the population is such that 
rankings of this type have appreciable probability, it would be expected that tests based 
on (ii) and (iii) would have different efficiencies. 

It would obviously be desirable if the performance of these coefficients could be studied 
for a fairly general class of distributions, in order to gain insight into the relationship 
between the coefficients. The class of bivariate distributions obtained from monotonic 
transformations of variates originally possessing a bivariate Normal distribution has been 
studied by Fieller, Hartley & Pearson (1957) by means of random samples of correlated 
Normal deviates. They concluded that for sample sizes 30 and 50 with correlation greater 
than 0-6 in the original bivariate normal distribution Kenda!l’s coefficient was probably 
better than Spearman’s. Correspondence with one of the authors, E. 8. Pearson, indicates 
that the Fisher-Yates statistic mentioned in their paper is better than either rank correla- 
tion coefficient within this same field. Another such general class of distributions has been 
considered by Konijn (1958), namely, the class derived from linear combinations of two 
independent variables. 

It is the purpose of this paper first to propose a general class of bivariate distribution 
functions; secondly, to study how the various coefficients of association compare in efficiency 
with each other and with a maximum likelihood estimator of the parameter of association; 
and finally to use the general results to determine which are the best coefficients to use in 
a number of special cases. The efficiency measure used in this paper will be the asymptotic 
relative efficiency, in the neighbourhood of independence, as defined by Pitman (1948). 

The form of the bivariate distribution function proposed in this paper is an extension of 
an idea of Morgenstern; see, for example, Gumbel (1958). Morgenstern (1956) proposed 
F(x) Gy) [1+ a{1 —F(x)} {1—G(y)}] as a bivariate distribution function having F(x), G(y) 
as marginal distribution functions, and Gumbel noted that this differed from the bivariate 
normal distribution if F(x) = O(a) and G(y) = O(y) where ® is the normal error function. 
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2. PROPOSED CLASS OF ALTERNATIVE HYPOTHESES 
Let F(x) be the marginal continuous distribution function of x, 
G(y) be the marginal continuous distribution function of y, 
A{F(x)} be a function of x that tends to zero as F(x) > 1, 
B{G(y)} be a function of y that tends to zero as G(y) > 1. 


Then A(x, y) = F(x) G(y)[1+aA(F) B(G)] is a suitably general class of bivariate dis- 
tribution functions for which the marginal distribution functions are F(x) and G(y). 

The functions, A(F’) and B(G@), are not completely arbitrary but, as will be shown later, 
it will suffice if we choose for A(F') and B(G@), functions that are bounded and have bounded 
first differential coefficients with respect to their arguments. Since a is a parameter measuring 
association, we can arrange without loss of generality that the least upper bounds on 
| A(F)| and on |B(@)| are both 1. The expression for H(z, y) is then unique. 

Consider a general family of two-dimensional distribution functions, L(x, y; «), depending 
on a parameter a, which tend smoothly to F(x) G(y), a distribution function for independent 
variables, as « + 0. Then for sufficiently small « 


L(x, y3 a) = F(a) Gly) +02 («, 5 a) ano+ 0(@) 
= F(x) Gy) +aK (z,y) F(z) {1—F(e)} Ay) {1—Gly)} +0(2), say. 


Now K(x, y) may be expanded as a series of terms of the type a;xy where x and y are 
sets of orthogonal functions defined on F(x), G(y) respectively so that 


I xu dF (x) = |yoynaay) = 65. 


There are many such expansions: for example, it is possible to expand K(x, y) in a double 
sine series with }{7F(x)} and }{7G(y)} as the arguments; expansion in polynomials, such as 
Legendre polynomials, is also possible. Whatever method we use will provide an expansion 
of the type H(x, y) = F(x) G(y) {l+aza,;A,(F) B,(@)}, where A,(F), B,(@) tend to zero as 
F(x) and G(y) tend to 1 by virtue of the factors (1—F), (1—G@), and so are of the type con- 
sidered in this paper. 

We shall in this paper work with the simple form H(z, y) = F(x) G(y){1+aA(F) B(G@)} 
described above, but in fact the main results extend immediately to the more general form 
and hence can be regarded as applying to any family of bivariate distribution functions 
that tend smoothly to independence as a > 0. 


3. ConpiTIONs For H(z, y) TO BE A CONTINUOUS BIVARIATE DISTRIBUTION FUNCTION 


For H(z, y) to be a continuous bivariate distribution function the following must hold: 
(1) (x,y) is a differentiable monotonic increasing function of both z and y. 

(2) 0 < H(x,y) < 1 for all a and y. 

(3) lim A(z,y)=1, lim A(z,y) =0. 


zr, @ zr,y>—-@ 


For H(x, y) to have marginal distribution functions F(x) and G(y) it must further satisfy 


lim H(x,y) = G(y) and lim A(a,y) = F(z). 


I> yn 
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Consider the proposed form of H(x,y), namely H(x,y) = F(x) G(y){1+aA(F) B(@)}. 
Now. lim H(z,y) = F(00) G(oo) + aF (00) G(oo) A(1) B(1) 
pia = 14+0A(1) B(1) =1. 
Since A(1) and B(1) are both assumed to be zero. Further, 


lim H(x,y)=0 
2,y>—o 
because A and B are both finite. Now we require that H(z, y) should be a monotonic in- 
creasing function of x and y; i.e. that 


pein 
Ox Oy 





‘ - d(FA)d(GB) 

= F'(x)G wy) {+a dF dQ > 0. 

Since FA is a continuous function of F that is zero at both ends of the interval (0, 1) and 
we may suppose that F'A + 0, the derivative {d(f'A)}/dF must attain both negative and 
positive values, and similarly for {d(@B)}/dG@: the product of the two can also, therefore, 
have both positive and negative values. We have required the derivatives to be bounded 
so that — UU, < {d(FA)}/dF < M, and —M, < {d(GB)}/dG < M,, where M,, M,, M;, M, are 
chosen to be the least values for which these inequalities hold. The product 








d(F.A)d(GB) 
dF dG 
may vary as follows: 
— max (M, M,, M,M,) < ws Des < max (M, M,, M,M,); 
call these two limits — M@’ and + M”. Then 
d(FA)d(GB) 
we a" 


d(FA)d(GB)_ 
“ee 2% 


that is, when a > —1/M” anda < +1/M’. When this condition holds, we know that H(z, y) 
is monotonic, increasing from 0 to 1, and therefore must satisfy condition (1). The marginal 
distribution functions are to be F(x) and G(y), now 


lim H(z, y) = F(c0) Gy) {1+ 2A(1) BYy)} 
ia =G(y), since A(1)=0. 
Similarly lim H(z, y) = F(x) 


yo 
because B(1) = 0. 


whenever 





4, REGRESSION oF Y on X 
When two variables, X and Y, are not independent, the mean value taken by one of them, 
say X, for a fixed value of the other, say Y = y, is not usually a constant independent of y. 
The relationship between this conditional expectation and the fixed value y, the regression 
equation, is then of special interest. Considering our general bivariate function 


H(x,y) = F(x) Gy) {1+ A(z) Biy)} 
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+0 92 -1 
+o +a 
-| adF(x)+a as Bate dz 


FA 
No wf z— 2 —) dx is a constant, k say, so that the regression equation is 


d(GB) 


B(X|Y = y) = n,+ak Fe, 





where /1, is the unconditional mean of x. The only restrictions on {d(GB)}/dG@ are 


d(GB) 
dG 





(i) GB = 0forG =OandG=1, (ii) |GB| is bounded, (iii) is bounded. 








Over a suitable range of ~, therefore, we may make the regression of x on y any shape we 
please and examples are quoted later of linear, quadratic, triangular and discontinuous 
regression lines. 

4-1. Examples 
Linear regression equations 


(a) Let y be rectangularly distributed between 0 and 1, so that 


Gy)=y (®<y<}) 
and put B = 1—G. Then 
+* a(FA) |. 


E(X|Y =y) = e+ (1=2y) |” — 


so that the regression of x on y is linear. 
(b) In general, let Y have the distribution function G with mear. yw, and variance oj, and 


G 
put {d(GB)}/dG = (Y—y,). Then GB -| (Y—y,)dG@ satisfies GB > 0 as G > 0 and also 
0 


GB > 0as @ > 1. If Y is of finite range then {d(@B)}/dG and GB will both be finite and there 
will be a range of « for which the bivariate function is a true distribution function. If Y is 
not of finite range then there will be no range of « for which the bivariate function is a true 
distribution function. However, we may arrange that our general bivariate function repre- 
sents a truncated form of the distribution. Choose the truncation points, X,, X,, Y,, Yo, 


h that 
biessiaeen X,=y,- (Mle), Y,=n,- (Mle), 
X_ = fz+ (Mle), Yy = py +/(M/e); 


then our bivariate function is a true distribution function for values of a between + ¢/M. 
Asymptotic relative efficiency is measured against alternatives that differ from the null 
hypothesis by amounts that become vanishingly small in the limit and we can choose these 
alternatives to be of the form « = an-?, where a is a constant. This value of « will be inside 
the range +e¢/M if we make ¢ a function of n such that an- < e(n)/M < bn- say. Then in 
our limiting process not only does the parameter of association tend to zero but the trunca- 
tion introduced cuts off a proportion of the original distribution that tends to zero at least 
as quickly as n- by virtue of Tchebychev inequality, P{(X—) > ./(M/e)} < o%e/M. 
Continuity considerations lead us to assign the same A.R.E. to both the true alternatives 
and the truncated alternatives in the neighbourhood of « = 0. 
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With this modification to the original bivariate function permitted, it is possible to 
represent the bivariate normal distribution function in the form 
H (x,y) = F(x) G(y) {1+ aA(x) Bly)}. 


x y 
Consider, H (x,y) -{" | on(l = exp — }(x? — 2pxy + y”) dxdy 


for small values of p and for x and y not too large: we can expand the integrand in powers 
of p and obtain 


ec fe 3 
H(e,y) =|" |" s-(exp— 2°) (exp—y") (1 + pzy + 0(p))dedy 


by ignoring the small probability that « and y take large values. This can be written as 
A(x,y) = F(x) G(y) {1+ A(x) B(y)} if we put 


1 " 1 y 
F(x) =——|__ exp—H#2dt, Gly) = _— | exp — Hdl, 
( ) "a5. P-3 (y) (27) = P-3 


Quadratic regression equations 
(a) Let y be rectangularly distributed on the interval (0, 1). Then, 
Gy)=y (0<y< 1), 
put B(y) = 1—y?; then the regression equation becomes 
E(X|¥ =y)=4,+(1 —3y2) | oe ae. 


This is a quadratic regression but it corresponds to a monotonic regression line; it is possible, 

however, to make the expectation of x reach a maximum or minimum value in the range of y. 

(b) Let y again be rectangularly distributed on the interval (0,1) and put B = 1—3y + 2y?, 
d(GB) 


a = 1—€ 2— 1 6y+ 6y?. 
dG 1-64 + 64 y + by 


This is a quadratic expression that reaches its minimum value where {d?(GB)}/dG? = 0; 
that is at G = 4. Thus the regression equation 


B(X|Y = y) = pet (1 6y + Oy?) | 2 ae 
has a stationary value at y = }. 
Triangular regression equations 


(a) Let y be rectangularly distributed on (0,1) and put 


B= 2y—3+(l/y) (G2 3), 
B=0 (G>1,G4< 0). 
The regression equation then reduces to 
+o d(FA 
B(X|¥ =y)=n,+ (1-4) [eC Dae w<h 


+o d(FA 
= e+ (ty-3)[ "eae y > 9) 


=" x 
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Discontinuous regression equations 


It is not, however, necessary that {d(@B)}/dG should be continuous but only that GB 
should be continuous; as an example consider y to be rectangularly distributed on (0, 1). 





_ B=1-2y (@<}), B=0 (@>}4) 
d(GB) _ d(GB) _ 
The regression equation then reduces to the form 
+° d(FA 
B(X|Y =y)= et [ 2G aa-ay) <P 
= Me (y > 3) 


and is composed of two line segments that are disconnected. 

When we compare the efficiency of two rank correlation coefficients with one another, 
the answer is clearly invariant under monotonic functional transformations of x or y. 
Therefore we may consider a canonical form of the distribution obtained after probability 
integral transformations have converted the marginal distributions into rectangular dis- 
tributions over (0, 1). Then the distribution function is 


xy{1 + aA (x) Bly)} 
and the regression equation of x on y is 
d 
K(X|Y¥ = 9) =n. +ake By} 


= fh, + ak{B(y) + yB' (y)}. 


Thus the functions A(x), B(y) are very simply related to the slope of the regression curves 
in the canonical form. Subject to the restrictions on A, B considered above, regression 
equations of any slope can be produced by choice of A and B, and conversely the form of 
the regression curve determines A, B. If we wish to produce two distributions with the same 
regression lines but, say, different scedastic curves we must pass to the more general form 
described in § 2. 


5. THE EVALUATION OF THE MEAN VALUE OF SPEARMAN’S 
RANK CORRELATION COEFFICIENT 


Consider the Spearman coefficient of rank correlation 


63 (a 
eee 1 


"3 ~ n(n?—1)? 


where d,, is the difference between the ranks of the x and y variates for the kth member of 
the sample. 

To determine the asymptotic relative efficiency of the Spearman’s rank correlation 
coefficient when compared with the maximum likelihood estimator of « it is necessary 
to know: 

(a) the variance when a = 0; 

(b) the mean value when « is small. 
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The first of these is 1/(m—1) (Kendall, 1943). The mean value under the hypothesis of 
dependence will be calculated in the following discussion. First, it is necessary to define 
some symbols. The subject of study will be samples of n pairs of values, one x value and 
one y value in each pair (the two values might for instance be the hardness and the tensile 
strength of some test piece) and we can consider the pair as a single entry to form one element 
of the sample. We can name these n elements 1, 2,..., without considering the variate 
values composing the sample element, in such a way that each element is equally likely 
to receive any number from 1 to n. After this allocation of names we can refer to the x and y 
values associated with the kth sample element and we write 

2x, to represent the x value associated with the kth element, 

y;, to represent the y value associated with the kth element, 
and 7(z;,) to be the number of x values in the sample less than or equal to z,,. Similarly j(y;,) 
is the number of y values in the sample less than or equal to y,. The functions i(x,) and j(y;,) 
serve to rank the z and y variate values. 

Let i be the column vector {i(x,), i(x), ..., i(x,)}’, and let j be the column vector 
{G(Ys)» F(Ya)> «+++ (Yn)}"- 

The probability that the first element will have values (x,, y,), the second (2,, y,), etc., is 

ee (GB) 


For small values of a we may expand isi as far as terms linear in a to give 


d(FA) d(GB)\ 
¢ OF (x;,)dG(y;,)) “x 


The probability that the two column vectors of ranks are i and j will then be given by 
integrating dP over the region R for which the ranks i(x,), j(y;,); = 1, 2,...,n are the same 
as those observed. 

The ordering of the names of the sample elements is immaterial to the determination of r,; 
each of the orders is equally likely and there are n! such orderings. The probability of any 
arrangement of x and y ranks will therefore be n! times the probability just calculated for 
the occurrence of the two ranking vectors i and j. The expected value of r, is given by 


d(F A) d(@B) 
E(r,) =n! ll He F(x,)dG 
(r) = Era)... [142 DS Fay, LaF ex) aC), 


where = is taken as the summation over all distinct arrangements of i, j. Two arrangements 
will be indistinguishabie if they can be reached from one another by identical permutations 
of the rows of the i and j vectors. 


We may ignore the unity term since this corresponds to E(r,) when « = 0 and is therefore 0. 


Also 
d(FA) d(GB) 
” fs {Pa dF (x,)dG Tas I] dF (x,) d@(y,) = 


dP = li+a sna II dF (x,) dG(y,.). 





k 
since this represents the coefficient of « in the probability that some arrangement of « 
and y values occurs and this has a constant value of one. 

Now by virtue of the equivalent form of Spearman’s rank correlation coefficient as the 
product moment correlation coefficient of the ranks considered as variate values, we can 


write Pe ii n(n +1)? 
fees |) a ob 
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~ n(n? — sie 4 
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12 n(n+ "| 





(FA) d(GB) 
! 
i ee saan if Ba dF (x;) (a) dG(y,) asl 


Consider now one item in the inner sum; say, that associated with the kth sample element. 


Call this J,,. ‘Then 


Ov?) i d(GB) 
h=|-[iy dF(a,) 1 1 ag (y,) om y)- 


This is separable into two parts, one in x and one in y. Thus 


ha). are at a 9 laa G yy Hae Mi) 


where R, is the region where the z’s are ordered in the desired way and R, is the region where 
the y’s are ordered in the desired way. Change the variables in the problem to F; (i = 1,...,”) 
and G; (j = 1,...,n) so that F{(zx,)} is written as F,{(2,)} and G{(y,)} is written as G,{(y,)}. 
The suffices i and j correspond to the value of the function i(x,) and 7(y,,); that is, the ranks 
of the x and y values associated with the kth sample element. 


1 1 1 1dF. 1) PF: F, 
1, =| aF, | dF,1...| dF] oor | dF....| dF, 
? Fa—1 Fa-: Fi 0 a 0 0 


. 


m legs ‘dFA(F) Fi F 1(1—G)"1dGB(@) Gi- 
Je (w—s)l 6aF 6G-1)! 0 


1 1dG. BIG.) r@ G 
x dG, ... st ea “dG 1---| dG, 
“. oo Gy Fp” 0 


dG 





(n—j)! d@ (j-1)! 


= 4,(t) ®,(j) 


The total inner sum is therefore obtained by summing, over k, these contributions 
A,({t) D,( 7) and if we define 


this sums © 0,,(t) ®,(j) = 


0, b, 
6 = Me and @®= Os : 
6, by 
0’d. Now 
E(r,) = wat %~ S(i'j) (0S), 


of which the more interesting part is the summation. Call this sum S; then 


S = X(i'j) (0’®) 


contains n*n! terms that can be grouped into n?(n — 1)? — 2! terms of the type kl0(i) (7), 


i+k, 7 +1; n2(n-—1)n—- 


abandoned. 


2! terms of the type 7j(i) ®(7), suffices to 0 and ® can now be 


f 
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Summation over the k + i and the l + j gives 


8 = EE Hi) Oj AT P- i) (M3) + — ni] (m2) 


(Me + )- we (t+J) 





= EDA) Oj) +nij| (n—2)! 


nt. 


n(n a a 








= (n—2)! {x (i) 063) 


mit 1) 





[2 19(0) & PCG) + HIM =X Bs Ht) +m ¥ 10() HIM(9) . 











1(1—F)"-t Fi dF A(F) 1 [aan ae 


‘ at omen . east Se = 
But zai) = 3 | iY ae eo a 


ere no omerts Pe 
id}: Similarly 0(j) = 0. 
aks | 
LiO(t) = X(t —1 + 1) A(t) = X(@—1) O(2)_ by the preceding result 
1(1—F)** Ft? FA FA(F 
90 n—-t t-2! dF 


1 
- a ptFAlP) ay 
N—<2: Jo 





"aR 





dF 


' 
Therefore, s. *- re A(P) ap oe dG, 
n—2!n—2! 


so that E(r,) = wah) es 3 {. Fag (F) dF f —— dG 


_ l2an ai 


ons 


[F2Ap— -{. radF} | {te2B - {. eBac 


12an 1 
, paar} ||" eBaa\ > 122 ‘FAdF\| GBdG 
n+1\Jo 0 0 0 
as n> ©. 


The estimate of a by the Spearman coefficient is therefore, 
Ts 


1 a 
12 radr | GBdG 
20 0 





Cce= 


for large values of n, and in the null case this estimate has variance 
1 1 
. n (fl 2; 71 2 
(3) 14a [ra ar } eBac 
0 


v be J0 
for large values of n. 


20 Biom. 47 
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6. THE EVALUATION OF THE MEAN VALUE OF KENDALL’S 
ALTERNATIVE COEFFICIENT OF CORRELATION, ¢ 
6-1. General 

Consider now the coefficient of correlation defined by 

28 
n(n—1)’ 
where S is the score obtained from a sample of n bivariate observations (x, y) by arranging 
either x or y, say x, in the natural order and considering the disorder produced in the y 
values. The magnitude of the score is found by taking the y values in pairs from this ordered 
sequence of observations and scoring + 1 if the ordering is the same as in the natural ordering 
of the y values and scoring — 1 if the ordering is the reverse of the natural ordering. 

Hoeffding (1947) obtained the mean and variance of the distribution of this alternative 
coefficient by considering the probability of concordance. The probability of concordance, 
7, is defined as the probability that, if two elements of the bivariate population are chosen, 
say (21,4) (%g,¥2), then the product (x,—x,)(y,—¥Y_) is positive. With this definition, an 
estimate, p, of 7 obtained from the sample is obviously the number of concordant pairs out 


of the ${n(n—1)} possible pairs divided by }{n(n—1)} but the number of concordant pairs 
is just the number of + 1’s in the score S. Therefore 


(n— =) 


t= 


n(n—1) 


-(1-p) “= 8, 





28 = 2pn(n—1)—(n—1) 
and t = 2p-1; 


also from Hoeffding, when a = 0, the variance of t = 4/(9n). 


6:2. Particular results 


The probability of concordance, 7, is defined as the probability that, if two elements 
of the population are chosen, say (%,, ¥;) (%q, yz), then (%,—2_) (y;—Y_) > 0. 

Now the probability of (71, y,) (%2, Ya) i8 h(21, y,) A(x2, Y2) dx, dx,dy,dy, and the probability 
conditional upon 2, < 2, is 2h(%1, y,) h(x, y2) dx, dx,dy, dy. 

The probability required is the integral of this probability element over the region 


Yy < Yo; i.e. +0 (2X, +2 (Ys 
n= 2 i | .’ h(x, Y1) A(%e, Ya) dy, dy,dx, dxq; 


when « is small we may neglect: terms in a? and higher powers. 


‘win Ho dF,A,dG,B, dF,A,dG,B, 
Zod i Mt ale it ae ae || ag, aa, aR aF, 


changing the variables from x,, %, y,, y, to F,, Fy, G,, G2, 
Ga 
wet lar+e [’ [5 = dk 1a, | 5 a as dG, de, 


G, 
+f i ane tan ff aa, 346, || 


= t+4a(["raar |’ pad, 
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Therefore E(t) = 2E(p)-1 
i = 27-1 
; 1 1 
= 8a (| Paar | aBae). 
0 0 


The estimate of a by Kendall’s coefficient, t, is 
t 





he = a cote i th 
a 8 FA ar | GBdG 
ed and in the null case this estimate has variance 
= 4 l 
| on eT: ee 1 i 
ve | 64 | FAGF | epaa 
ce, 0 0 
on, 1 
an : i eae ae 

or 144m } FAdF I aBac| 
ut 0 0 
a asymptotically the same as the estimate by Spearman’s correlation cvefficient. Therefore, 

> these two rank correlation estimates have the same asymptotic relative efficiency. 
This property holds for the more general bivariate function mentioned in § 2, namely 
H (x,y) = F(x) Gy) {1+ ada, A,(x) B,y)}. 
An important step in any of the arguments seeking the expected value of a statistic for 
small values of « is that which equates 
d(FA) a) 
(140g) ands, 

its | . d(F A)d(GB) 
ity 


This step for the more general bivariate function leads to 


dF A),d(GB), 
(i+axZa, TR ae, ) manag, 


on 








which can be written as 


d(FA),d(GB), 
(140 ae ag, |) aha 








It can be seen therefore that the expected value under this more general hypothesis is 
a weighted sum of the expected values under a series of hypotheses of the type already 
considered, the weight used being a property of the distribution function and not of the 
statistics being studied. We have shown that for all hypotheses of the simple type, E(r,) 
is 1-5H(t) and this must also apply to similarly weighted sums of these expectations. From 
' this it follows that the asymptotic relative efficiencies of the two rank correlation coefficients 
is the same for all distribution functions that allow an expansion of the more general kind 
in which each term separately could represent a true distribution function when taken with 
the term independent of «. 


20-2 
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7. THE MEAN AND VARIANCE OF THE PRODUCT MOMENT CORRELATION COEFFICIENT 
The variance of the product moment correlation coefficient 





¥ 2 (xY)2 
where =. X,=EX¥Y-—"—-, X,=Ex?-““~ ond X,=EY?-—— 


can be shown to be asymptotically 1/n (Kendall, 1943). 
When 1 is large, X,, X,, X, will all be close to their respective mean values 
My = E(X—p,)(Y—-My), M2 = E(X—H,)*, Ms = H(Y—4,)?, 
so that we may write 
X= M+, X_,=(1+e:), Xs = My(1 +6), 
where ¢,, €, and €, have zero mean and very small variances. Expanding in terms of powers 
of €,, €g, €3 gives My 





T~ i €2) + 
Tita) ~ $a) V (He eo 
Taking expectation of both sides gives 
Br) = BEBE Be) oa | Fs" oi (FA) 15 f oo Tom) UGB) ag 
CO, Cy 0 CO, 


The estimator «,, for «, obtained from the poe moment correlation coefficient is, 


therefore, 
([F4)3 = a aye fay ae 
0 Oy Oy 


and this estimator has in the null case a variance of 


a, = 














1 
“lf (= #2) A) om "(a TE aa)" 
0 CO, G 
1y,U(FA) 5, _ 


so that this variance may be written as 


nf {’ Dae yaal 





8. THE MAXIMUM LIKELIHOOD ESTIMATOR OF THE PARAMETER 
The probability of obtaining (x, y;) (%2Y-) (%3Y3) --- (%_Y,) a8 the n sample elements is 
d(FA),d(GB), 
tI f tae ae. | araG,. 


The log-likelihood is, therefore, 





d(FA) aon) 
L = Dog (140 ee) 
Slog ( +¢— aR dG, 
UPA) aOB) 
aL qF dd, 
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The maximum likelihood estimator is found by equating this to zero. When « is small and 
for large n, 2 will also be small so that we may expand 














7 © 1g UPA UGB), 
(1-0 a a | 
dF, dG, 


so that the maximum likelihood equation becomes 


aFA)d(GB) 5 5 (Agden - 
; as a, Tl ee ag) =° 














The variance of this estimator is obtainable from the form of the likelihood function and 
under suitable conditions the asymptotic variance of @ is given by 


ee 
ver Pe 





™ (2) CaN CP 
co ee 
and var & = 





Tyo eaye 


9. ASYMPTOTIC RELATIVE EFFICIENCIES 


As has already been shown in §§ 5-8 the mean value of the Spearman’s rank correlation 
coefficient, r,, Kendall’s coefficient, ¢, the product moment correlation coefficient, r, and 
the maximum likelihood estimate @ are: 


1 1 1 
E(r,) = 12a | FAdF i GBdG or more generally 12a >a; [ FA,dF GB,dG; 
0 0 i 0 


J0 


E(t) = 8a [ 


0 


Br) = ra a i Ea | xs aP [’ y OB) ag, 
0 0 


1 1 1 
FA ar | GBdG or more generally 8a> a. FAAP | GB,dG@; 
i 0 








dF C,C dF dG 


aly i 


E(&) = a. 
The variances of r,, t, ry and @ under the hypothesis « = 0 are: 
1 + 1 
var (7,) = —— var (¢) = on? var (7) = “ 
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"|. Car) 2”), (Cae) 2 


var (2) = 
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considering only the sample bivariate function without summation, the asymptotic relative 
efficiencies relative to the maximum likelihood estimate are, for r, and ¢, 


144 (|. PA ar | cBaa) 
Tee ea 


and for r (J. “ar “Ff, ¢ “ag %) 
aa PTT Ce 


It can be seen that each efficiency is the product of an element dependent only on functions 
associated with a and a second dependent on the corresponding functions of y. If we wish 
to find the functions of a and y that make these asymptotic relative efficiencies the greatest 
for each of the estimators of «, it suffices to maximize each of these elements separately. 
This property does not hold for the more general case and hence we will restrict attention to 
the simple bivariate function. For this class of bivariate distribution functions the two rank 
correlation estimators are equivalent in their asymptotic relative efficiences. 








10. DETERMINATION OF THE ‘BEST’ BIVARIATE DISTRIBUTION FUNCTIONS 


(a) What are the functions G(y) and B(G(y)), F(x) and A(F(x)), that maximize the 
relative efficiencies of the rank correlation estimators when compared with the maximum 
likelihood estimators ? 

This problem can be solved by the Calculus of Variations. For this, we look for the func- 
tion A(F(x)) that maximizes the variance of the maximum likelihood estimate subject to 
a fixed variance for the rank correlation coefficients. 

To find the stationary value of {. (“ae) dF subject to | PAF = constant = 1, 

0 
sa ut 71 
(say), p [for +ayjaz - V, 
where y = FA anda = F. 
The function y that yields a stationary value for the integral is given by 


7 sy 
0-5 -2(5). 


Oy dx \dy’ 
0 =A-2y’, 
Ax? 
or y= teurt+d. 


Now y = 0 when x = 0 and x = 1; therefore 
A A , 
y = 7x12) and A =< (1-—F). 


The asymptotic relative efficiency for this choice of A is 


1 4)2)2 1 
isa x(1—a) del a ; = ,=1. 
si agaal{ (1—20)Pdel 
0 
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This incidentally proves that the stationary value we have found is the one corresponding 
to the greatest efficiency for rank correlation methods. 

Referring back to § 2, this is the distribution quoted there as having a linear regression 
of the expectation of x given y when y is rectangularly distributed, and is one for which ranks 
and variate values are asymptotically perfectly correlated (Stuart, 1954). 

(6) The determination of functions G(y) and B(G(y)), F(x) and A(F(z)), that maximize 
the relative efficiency of the product moment correlation estimator when compared with 
the maximum likelihood estimator requires that we find the stationary value of 


1 (d(F'A)\? ; 1 d(FA) 
i, (“Tr ) dF subject to I. oa aE = constant, 
and x having mean yw and variance o?. We can, without loss of generality, choose the scale 
of x such that «4 = 0, 0? = 1. Put {d(F'A)}/dF = 2,4 = y, dF = dx and 


1 
V = [ {22+ Ayyzt+Agy+Azy"} dz. 
Jo 


The required functions can be found as the solutions of 
AyZ+A_+ 2Azsy = 0, 
2z+A,y = 0; 


multiply eath of the determining equations by y and integrate over x from 0 to 1, and use 
the relations 


ol 1 1 
| yzdx = a, | ydx = 0, [ edz = 1; 
0 0 J0 


then A,a+2A,=0 and 2a+A,1=0. 


Solving these equations and making the appropriate substitutions, including a return to 
the original variables, gives {d(f'A)}/dF = ax and thus 


F 
ra =a{ avdF 
0 


by the requirement, A = 0 when F = 0. 
The relationship between F and x is undetermined. 
The asymptotic relative efficiency is 


(|. aztaP) /({' a%etar) tee 


This again shows that this stationary value is indeed that which gives the greatest efficiency 
for the product moment correlation coefficient and not some least value. 

(c) The stationary value for the asymptotic relative efficiencies, when comparing the 
product moment correlation coefficient and the rank correlation coefficients, is found to 
be neither a maximum nor a minimum value. 

The position found is that of the intersection of the best forms for the rank correlation 
coefficients and the product moment correlation coefficient, namely . 


z= FA=aF(1-F), 
y = 3(1—2x) = 3(1—2F), 
[iyae =3F(1-F)=2z if a=+3. 
0 
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Thus along line A = 1—F, the rank correlation methods are better than the product- 
moment correlation coefficient; along A = [ “dF / [oar the product-moment correlation 
Jo 0 


coefficient is better than the rank correlation estimators. At the intersection, each is equally 
efficient with the maximum likelihood estimator. 


11. SUMMARY 
Summarizing these results we have: 


(1) The product-moment correlation coefficient is fully efficient whenever the disturbing 
functions A(x) and B(y) are of the form 


A(a)= |" ear /{" ar and By) =|" yaa] |" aa, 


where the origin of x is taken to be at the mean value of z, and that of ¥ at its mean value. 
(2) The two rank correlation coefficients considered are equally asymptotically efficient 
and are fully efficient if the disturbing functions A(x) and B(y) are given by 


A(z) =1-—F(z), By) = 1—Gly). 


Recalling the result of 4-1 (c) we see that the product-moment correlation coefficient will 
be most efficient for those distributions for which the regression of y on x, and x on y are 
both linear. If we consider Spearman’s rank correlation coefficient it is clear that here also 
we have a linear regression of F(x) on G(y) and G(y) on F(x) and the rank correlation 
coefficient corresponds to a product-moment correlation coefficient using expected scores, 
namely i/(n +1) for the variates. 

Hence, if a transformation of the x and y values can be found for which the regressions 
of the variables on each other are linear, the product-moment correlation coefficient in 
these transformed variables will be a fully efficient test for the association of the two variates. 
This can be achieved if we write {d(GB)}/dG = ¢(y) and use the variable ¢(y) = z as the 
transformed variable for y and the corresponding w = {d(F'A)}/dF as the transformed 
variable for x. 

The product-moment correlation coefficient in these new variables will provide an 
asymptotically efficient test of association. 

The transformation need not be monotone in character since,with the present class of 
bivariate distribution, the conditional distribution of x is affected by y only in the form 
{d(@B)}/dG@; hence for the values of y for which {d(@B)}/dG is the same it is immaterial which 
of the y values has in fact been observed and no information is lost in pooling them into 
a common value z. 

The rank correlation corresponding to this statistic will be the product-moment corre- 
lation coefficient using the expected values of the order statistics in place of the observed 
values and would correspond therefore to scores 


1 d(FA) 
~~ cue N-1 
[F op (l- Fy dF 


when {d(F'A)}/dF is a monotone function. 
It is interesting to seek intuitive reasons why these last-mentioned statistics should be 
efficient. A property of the bivariate distribution considered is that the conditional dis- 


_. tie ee 2 ee 
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ct- tribution function of X, given the value of Y, is distorted by a function that is constant in 


ion shape for all y but of varying magnitude. As a consequence of this, it follows that there 
i will be some values of X, independent of the Y chosen, for which the conditional prob- 
ability density function shows the greatest deviation from the p.d_f. in the case of indepen- 
dence. We may expect that an efficient test will give greater weight to observations falling 
at these points and, since the function has some symmetry in the X and Y variables, the 
same will hold for the y values. 
There will be some optimal relative weighting between the various x values that is 
ing independent of the chosen y and vice-versa. If each observation (x,y) is given a score 
W(x, y) this implies 


ally 


W(x, y|y) = w(x) x function of y, 
W(x, y|x) = w,(y) x function of x 


™ and thus W (x,y) = w,(x) w(y) x constant. 

. a 

ent The test, therefore, seems likely to be a kind of product-moment correlation coefficient 
with x replaced by w,(x) and y replaced by w,(y). The analysis of this paper shows that 

w,(x) = {d(FA)}/dF andthat w,(y) = {d(GB)}/dé. 

will In a further paper it is hoped to extend the results of this paper to the general class of 

are | rank correlation coefficients introduced by Daniels (1944). 

ilso 

ion The author would like to express his thanks to Dr D. R. Cox for helpful criticism and 

res, advice during the preparation of this paper. This work was carried out as part of a course 
of postgraduate study in statistics at Birkbeck College, London. 
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Two expansions for the quadrivariate normal integral* 


By J. A. McFADDEN 


Purdue University 


1. IntTRODUCTION 


Let X,, X,, X, and X, obey a quadrivariate normal distribution with zero means, and 
let P, be the value of the quadrivariate normal integral, i.e. the probability that X,, X,, X, 
and X, are simultaneously positive. The generalized tetrachoric »:ries for P,, as given by 
Aitken (unpublished), Kendall (1941, 1945) (see also Kendall & Stuart, 1958, pp. 350-4), 
and Moran (1948), are not well suited for computation. For the case in which all six correla- 
tion coefficients are equal, the series has been summed approximate’ vy McFadden 
(1956). 

For special numerical values of the correlation matrix, exact results for P, have been given 
by Schlafli (1858, 1860), Anis & Lloyd (1953), and Plackett (1954). Methods for numerical 
integration in more general cases have been given by Plackett (1954), Thm (1959), and John 
(1959). Numerical methods for integration when all the correlation coefficients are equal 
have been provided by Ruben (1954) and Moran (1956). 

In this paper we present two series expansions for P, which are well suited for computation. 
The first case occurs when X,, X,, X, and X, are successive measurements from a stationary 
Gaussian Markov process (with zero mean), or, equivalently, when the inverse of the corre- 
lation matrix has zero elements except on the main diagonal and immediately adjacent 
to it. The second case occurs when the correlation matrix itself has zero elements except 
on the main diagonal and adjacent to it. We shall then show that these two cases are related 
by a simple transformation. 

In a previous paper, McFadden (1955, eq. (39)) has expressed P, in terms of the various 
product moments of the set of random variables Y; which assume the sign of the normal 


variables X;. Let 
Y,;=1 when X;> 0) 


¢ = 1, 2,3, 4). 1 
=-—1 when X,< 0) , si 
4 
Then P, = ol ! + > HY,Y;)+£%, rYY)), (2) 
j>i>1 
- 
where E(Y;Y;) = 7 Sin Piss (3) 


and p;; is the correlation coefficient between X; and X,. In general, the fourth product 
moment in (2) depends on all six correlation coefficients, but in the two cases to be con- 
sidered it depends on only three. In each of the two cases we shall derive a series expansion 
for L(Y, Y,Y;,Y,) in powers of py. 


* This work was supported by the Office of Naval Research, U.S. Navy. Some of these results were 
first presented to the Institute of Mathematical Statistics at Lafayette, Indiana, 9 April 1960. (McFadden 
1960.) 
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2. Tur MARKOV CASE 


Suppose that X,, X,, X, and X, are successive measurements from a stationary Gaussian 
Markov process with zero mean. For convenience we shall take the variance of X; to be 
unity. Then it is known (Doob, 1942, p. 354) that the autocorrelation function is exponential, 
and consequently ‘ L 

P13 = Pi2P233 P14 = Pi2P23P343 Pea = P23P3a- (4) 
Thus we may express the six second-order moments in (2) in terms of (45, P23 and Pq. 

Let us now derive the fourth-order moment EH(Y,Y,Y,Y,). For the Markov case, we define 

this function as follows 
E(Y,Y2¥3¥,) = W(p42; Poss Psa)- (5) 


Because of the Markov property, we may express the joint probability density of the X; 
as follows (Doob, 1942, p. 353) 
fo3(X2, X3) (6) 
Fo(2) fs(%5)’ 
where f;(z;) is the marginal density function for the standardized normal distribution and 
fis(%4, 2;) is the bivariate density function. Thus 


f(a, %g, Lg, Xq) = fyo(%1, Le) fga(Xs, Xa) 


fi(x;) = (27)-* exp (— 427); (7) 
SiglX, xj) = (27)1 (1 —p?,;)-3 exp[—4(1 — pi) (xi- 2pig% i+ x4)]. (8) 


[The resulting expression for P, will actually hold for any quadrivariate normal density of 
the type (6) in which the four variances are arbitrary and not necessarily equal; we have 
taken them equal to unity only for convenience. The assumption of stationarity requires 
that the variances be equal, but the assumption of a stationary Markov process could be 
replaced by the hypothesis (6) with arbitrary variances. Note also that the products 
X1X3, Xx, and xx, do not appear. | 

We may expand the last factor of (6) in Mehler’s series of Hermite polynomials (Cramér, 
1946, p. 133). 
jae (pha) b exp (— 4(1— pls) (Path — 2p asta + pathy] = 3 BAA) pg, 

(9) 

Thus we may expand (6) in a series, each term containing two factors, one depending on 2, 
and 2,, and the other depending on x, and x,. By the definition (5), we find that 


W (P42; P23, Psa) = ~ = ,(Py2) &,(Pga), (10) 


where the expectations %,(Py2) = EB[Y,¥,H,(X2)],) 


(11) 
&,(P34) = E[Y,Y,H,(X3)] J 


require integration in only two dimensions instead of four. 

By the symmetry of the bivariate normal distribution, we find that these functions a, 
vanish when v is odd. In order to obtain the even cases, we must first calculate the general 
moment E(Y, Y, X3"), where n is a non-negative integer. The first few cases may be obtained 
from the results of Kamat (1953), but the following method yields the general result. 


he © te SD — 


vy 


0) 
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Rice (1944-45, §3-5) has given the formula 


[> [5 tumexp(—28—y* —2axy) dedy = 5 3 (= ee (ase yr (™). (12) 
0 Jo 








2 2 


With / = 0,m = 2nanda = — pj», a change of variables in (12) yields the contribution of the 
first quadrant to the desired moment. The contribution of the third quadrant is identical. 
The contributions of the second and fourth quadrants are also identical to that of the first, 
except that the expression is negative and furthermore p,, must be replaced by —/jp. 
As a result, all the terms of (12) cancel for which r is even. With r = 2s+ 1, we find that 


gn © (2p49)*8+1 
2n) — matty 12 
EQYXP) => (1p Dee yy PO+ En te+) 


gnt+l 
= —— 0! pra — p2.)"+4 F(1,n +1; 3; pis) 


Qn+1 . 
= 0! Pie P(3, 2-05 35 Pie): (13) 


This last step requires Kummer’s transformation (Erdélyi et al. 1953, p. 105, eq. (2)). 
Let us now express the Hermite polynomials of even order as follows (Magnus & Ober- 
hettinger, 1954, p. 82): 2 
fo) 7 X$ n 
Hy(X,) = (2, & ee (FY. (14) 
> n! 


-— 


where (a), = ['(a+n)/T(a). If we substitute (14) into (11), interchange the order of the 
operations, and employ (13), we find that 


tay(rs) = (—2) (Be E our te " EW,Y,X#) 





2 = one = (3)s (3-1), pid 
= —(-2)e(1 2/9 \2 ~ ls Fi2 
a 2 (2)aPr2 2, (3)n s=0 (3 8 s! (18) 
We now interchange the order of the summations and use the identity 
(—m), = ee (16) 
then we find that (15) becomes the following 
9 o (1 1 
cay(Prs) = =(— 2)" (BpPaa 3 Oe FB ca, — ps 4-95 1), (17) 
7 s=0 (3), 8! 


We now make use of the formula for the hypergeometric function of unit argument 
(Erdélyi et al. 1953, p. 61, eq. (14)). Ordinarily we could employ this formula only when 
je > 8+4, but because the series terminates we may effect the usual derivation (loc. cit.) 
without this restriction. After simplifying the expression (17), we find that 

O4(Pr2) = =e 2)" (—4),Pr2F(3,4—43 3-H Pie) (18) 


(— 2)" (—4), Pro(1 — pie) F(1, 1p; 3—; Pir), (19) 


the last step being Kummer’s transformation. 
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When yu = 0, (18) yields an arcsine function (Erdélyi et al. 1953, p. 102). 


23 
%(Pr2) = 7 sin- Piz (20) 


When yz > 1 the hypergeometric series in (19) become polynomials of degree (4 — 1) in pig. 
Thus the terms of the series (10) for W(p49, P23, P34) are well suited for nC As we 
eat ah in the appendix, (10) converges for all values in the range 0 < pj, < 1,0 < pis < 


< piu < 
er: a four terms of (10) appear as follows 


4 
W (P12, P23, Psa) = =, {sin pas SiN Pgq4+ Pr2P3a(1 — pi)? (1- — pi)? 


Ps 


«|e + +8814 2p) (1+ 2h) + 


*(3-+ dole + Soh) (8+ 4phi+ Sl.) +...|]. 
(21) 

We may test the validity of (10) in several examples. First, let us consider degenerate 
cases. If p,. = 0, then X, is independent of X,, X, and X,, and EH(Y,Y,Y,Y,) becomes 
E(Y,) E(¥,¥3Y,), which is zero. The series (10) also vanishes. 

If po, = 0, then X, and X, are independent of X, and X,, and EH(Y,Y,Y,Y,) becomes 
E(Y,Y,) E(¥;Y,), or, by (3), (4/77) sin~" p,. sin-'p,,. This result agrees with the first term 
of (10); the other terms vanish. 

If py. = 1, then Y,Y, = Y3=1 and E(Y,Y,Y,Y,) = E(¥;¥,) = (2/7) sin-1p5,. This result 
agrees with the first term of (10); the other terms vanish. 

If p23 = 1, then ¥,Y, = 1 and, by (3) and (4), H(Y, ¥,¥;¥,) = H(Y,¥Y,) = (2/7) sin (P4234). 
It is not obvious that (10) reduces to the same result, but the identity can be proved. 

One non-degenerate example is provided ¥? the exact result of Anis & Lloyd (1953), who 
have shown, in effect, that when pj. = P54 = \/(6)/4, Pig = Pog = /(6)/6, Pyq = F, and fog = §, 
then P, = }. These correlation coefficients satisfy (4). We may obtain the true value of W 
by (2), alk compare it with the result of a finite number of terms of (21). 

A more extreme test of the usefulness of (21) is provided by the results of Rice (1958, 
p. 623). When py. = Pos = P34 in the Markov case, Rice has calculated 2P, by numerical 
integration for several large values of the correlation coefficients. We can compare the 
results as before. 

We have made the comparison in W rather than in P, so as to accentuate the problem. 
It is clear that, if the second-order moments in (2) are positive, then the percentage error 
will be smaller in P, than in W. 

In the last column of the following table, we have used a non-linear sequence-to-sequence 
transformation due to Shanks (1955). If W,, is the sum of n terms of (21), we apply Shanks’s 
first-order transformation to the quantities 0, W,—W,, and W,— W, and add the result to Wy. 
This result we shall call ¢,(W,). 





From (21) 

True True cr A —, 

Piz Pes Pas P, W W, e,(W3) 
/(6)/4 2/3 /(€)/4 1/5 1/5 0-19990 0-19998 

0-9835 0-9835 0-9835 0-868/2 0-82 0-7956 0-8069 

0-9672 0-9672 0-9672 0-814/2 0-74 0-7238 0°7367 

0-9512 0-9512 0-9512 0-774/2 0-69 0-6719 0-6842 

0-9355 0-9355 09355 0-742/2 0-66 0-6297 0-6401 


0-8752 0-8752 0-8752 0-641/2 0-51 0-5048 0-5092 
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We may conclude from the table that four terms of the series (21) provide an adequate 
approximation to the fourth product moment W (and, when the correlation coefficients are 
positive, an excellent approximation to the quadrivariate normal integral P,), even when 
the correlation coefficients are relatively large. 

One application in which the series (10) leads to an exact result is to a problem involving 
noise in an electric circuit. If a stationary Gaussian Markov process (with zero mean) is 
infinitely clipped at the levels +1 as in (1), let the resulting binary process be the input 
to an RC low-pass filter. The fourth moment of the output of this filter is a fourfold integral 
involving W(4, P23, P34). Using (10), we can integrate term by term and express the 
resulting series in closed form (McFadden, unpublished). 


3. THE CASE IN WHICH fj3 = Py4 = Poy = 0 


Suppose again that X,, X,, X, and X, obey a quadrivariate normal distribution with zero 
means and arbitrary variances. Instead of assuming the relation (4), let us assume that 


Piz = Pia = Pog = 9. (22) 
These situations have been studied by Schlafli (1858, 1860) and van der Vaart (1955). 


(Schliafli used the term ‘orthoschemon’ to describe this case.) In order that the determinant 
of the correlation matrix be positive, we must prescribe that 


P23 < (1 —piz) (1 — piu). (23) 
For this case we define the fourth product moment by a different symbol: 
E(Y,Y,Y3¥,) = W (Pye; Pos; Psa)- (24) 


Let us now employ the generalized tetrachoric series (Moran, 1948). After a sorting of 
terms, we can manipulate Moran’s series for the general correlation matrix into the form (2), 
where 


(ja) E(Y,Y2¥3¥4) = Pr2Psa F (4, 4, 4, 45 3,4, 3,4, 4, 25 Plas Piss Pla» P23» Poa» Psa) 

+ Pi3Po, F (4,4, 4,45 4, §, 4, 4, 8, 35 Pia, Pis, Pia P23, P24 Psa) 

+ PrsPos F (4, 4, 4,45 4, 4, 8, 8, 4, 35 Pla» Ps Pitas P23> Poa P3a) 
—Pr2PisPia F (8, 4, 4,45 8, 8, 8, 4, 4, 35 Pies Pls Pia Pda» Poa Pa) 
—Pr2P23P oa F (4, $, 4,45 3, 4,4, 8, 8, 45 Pies Pls» Pia» P23» P24, P8s) 
— P13PosPsa F (4; 4, 3,45 4, 3, 4, 8,4, 35 Pies Piss Pia P23» Poa» P3a) 
—Py4PraPsa F (4, 3, 4, 35 4,4, 8,2, 3, 8 

$3 


» 4, 3, 35 Pie» Pls» Pia» PEs» P24 P34) 
+ P12P13P14P 23P24Psa F (8, 8, > 8, BB, 8,38; Piss Piss Pias P2as Pas Pia): 


> 


> 


(25) 
where A(_ ) is a generalized hypergeometric series, defined as follows: 
F (44, Ag, Ag, Aq; b,, bg, bg, bg, bs, bg; X1, Xa, Hg, Xq, Xs, Le) 
- nn (41 )i4+m+n(42)t+p+q(%3)m+p+r(a)n+a+r a: ay U3 xy xh x6 (26) 


l,m, n, p,q, 7r=0 (61); (b2)m (53)n (b4)p (b5)q (bg ), Lm! n! Pp: !q! i 


For the particular case (22), all but one of the series in (25) vanish and W becomes the 
triple series, 


> (3) bt (3 )i+p (B) p++ (3), pis 2 P28 P34 . (27) 
l,p,r=0 (3) (3)p (3), Uptr! 


4 
W (P12 Pog, Psa) = 72Pi2P 34 
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Now dip = (F +P) (B)p; (28) 
therefore we may rewrite (27) as re 
W (P12 Pes: Psa) = z oe pas S,,(P12)8 'p(Psa)s (29) 
2 
where S,(P12) = Pl (2, 3+; 3; pie) (30) 
2 
= = Proll — pin)? FL, 1—p; $5 pit), (31) 


the last step being Kummer’s transformation. 

As before, when p = 0, (30) yields an arcsine function, and when p > | the series in (31) 
become polynomials of degree (p — 1) in p?,. Thus these terms, too, are well suited for com- 
putation. As we shall prove in the appendix, (29) converges when 0 < p?, < 1,0 < p3, < 1, 
and (23) is satisfied. 

The first four terms of (29) appear as follows 





4 P12P 34 Ps Ps (3 — 2pj2) (3— 2p) 
W (P12 P23; Psa) = 7 sin pj, sin- ‘Put Gq, p2s)t (1— aoilat a! (1 —p?.) (1 — p24) 


pls (15 — 20p}, + Spf.) (15 — 20%, + Spf.) , a) 
6! (1 — pia)? (1 — pa)? “yy 

If one of the correlation coefficients vanishes, W reduces to zero or to two arcsines as 
before. 

In a large number of non-trivial examples of the case (22), Schlafli (1860, p. 98) has given 
exact values for P,. [These results have been summarized by Plackett (1954, p. 359) and 
some of them also by Coxeter (1935).] As before, we may compute the exact value of W 
by (2), and compare the partial sums of (32), with and without the non-linear transform. 
Some results are given below. 





From (32) 
True True cr A ~ 
Pisa Pos Psa P, W W, (Ws) 
—43 —} -3 th +s = 0-13333 0-13293 0-13329 
—1//2 —} -}4 wea vz Z 0-20833 0-20669 0-20799 
—4 —1/,/2 —}3 vist 43 ~ 0-18056 0-16869 0-17764 
— sin (77/10) —t -} wikis Boo Z 0078889 0-078715 0-078873 


[Incidentally, the first example can be done combinatorially, without assuming normality, 
in a manner similar to the method described by Plackett (1954, p. 360).] 

Again we observe that the agreement is good, although poorer near the edge of the region 
of convergence, as in the third example. 

A somewhat more complicated series for P, in the case (22) has been given by Coxeter 
(1935). [For the interpretation of Coxeter’s notation in terms of the present problem, we 
refer the reader to Plackett (1954, p. 359).] 


4, THE RELATION BETWEEN THE TWO CASES 


A simple relation exists between the functions W(p4p, Pos, P34) and W (Ajo, Agg, Agy) Of the 
two previous sections. To avoid confusion, we have introduced new variables A,; for the 
elements of the correlation matrix having the property (22). 





~~ oe — fF T-— 





29) 


30) 


32) 


y; 
on 


er 
ve 


1€ 
16 


Two expansions for the quadrivariate normal integral 331 


As a special case of an identity for hypergeometric functions (Erdélyi et al. 1953, p. 106, 
eq. (26)), we can show that* 
By 


F(1,1—p; $-p; 2) = in 
7 


We then find from (19) and (31) that 


F(1,1—y; 3;1-xz) (w#=1,2,3,...). (33) 


‘ ; 
May(Pr2) = ——(— 2)" (4), Pra(1 — Pia)* F(1, 1— ms $5 1 — pin) 


= —(—2) (3), p#S,[(1—pie)*] (w = 1,2,3,...). (34) 
We may now obtain the general even term in (10) (u + 0). 
3 (3), 
By 2e(Pas) (P34) = ma * (Pr2P23Ps4)™" S,[(1 — — pi)? ] 8,{(- —pix)}). (35) 
This is the general term of W(Aj9, Ag3, Aga) [ef. (29)] with Aj, replaced by (1 —/?,)t, Ag, by 


(1—p2,)*, and Ags by 42/23/34 (= P14). Then we may remove the zeroth terms of (10) and 
(29) and derive the identity 


aa : 
wil — pi2)}, P12P23Ps4 (1 — pi) ] = W(Py2; Pes: P34) + 1 —7 (sin™ Pigt+Sin™ pq), (36) 


or, conversely, 


A 
I _}2.\$ 
2 
= W (Ayo, Aes, Aga) + 1 —;7 (sin™ Ay2 + sin Ag,). (37) 


We may easily effect sign changes in the arguments above by considering that W (p49, Pos; Psa) 
is an odd function of p,, and p,, and an even function of p,3, and similarly for W. 

Thus if we know P, for either of the cases in the previous sections, we can find a corre- 
sponding solution for the other case by means of these transformations. Evidently this 
transformation is a special case of a ‘dissection of a plagioschemon [i.e. general correlation 
matrix] into orthoschemons’ [i.e. all elements zero except on the main diagonal and adjacent 
to it], as considered by Schliifli (1858, p. 293). In this case the ‘plagioschemon’ is the Markov 
case (4). 

As a special case of this transformation, consider the solution of Anis & Lloyd in § 2. If 
Pris = Psa = /(6)/4 and p25 = /(6)/6, then the arguments of Win (36) are Ay. = Ag, = /(10)/4 
and A,, = }. Then by (36), 


—/(10)/4, — 4, —4/(10)/4) = eres f, /(10)/4) 


6 ie. 
= ———sin-! 
5 sin (38) 


Then by (2), the corresponding value of P, for these negative arguments is the following: 


02. 1 6 6 
P, = : |1-Fsi sin 110 —sin-!— + $a al a 
1 1 1 


16 4°65) 
ea 
Oe sin~ }. (39) 


* This result was first shown to the author by Prof. I. Marx. 
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This result agrees with one of Schlifli’s examples [1860, p. 98, f(A, 2A, A)] (also Plackett, 
1954, p. 359, 13th item). 

Conversely, from all of Schliafli’s exact solutions we may derive corresponding solutions 
for the Markov case, thus adding to the catalogue of exact solutions for P,. 


5. CONCLUSION 


In this paper we have derived two new expansions for the quadrivariate normal integral, 
the first being applicable in the stationary Markov case (4) and the second being applicable 
when the correlation coefficients are all zero except on the main diagonal and adjacent to it. 
These expansions are well suited for computation. 

In addition, we have shown that either one of the two problems considered is reducible 
to the other by means of a simple transformation. 


APPENDIX* 


Let us now establish the convergence of the series (10) and (29), beginning with the latter. For large 
p, (31) becomes asymptotically (Erdélyi et al. 1953, p. 77, eq. (14)) 


2 : 1 1 
= as eae 
S5(P12) 7 Paral Piz) "i ph [ +O (—s) | > (40) 


~  Sp41(Pr2) 1 
lim rr 38 = ea > 
pa »\P12) Pie 


and it follows directly from (31) that the limit is also valid at p,, = 0. Therefore, using the ratio test, 
we find that (29) converges everywhere in the range 





where p?, > 0. Then (41) 


Pas < (1—pi,) (1— pa), 
0 < pie <1, (42) 
0 < Psa < 1, 


which is the region of importance in the present problem. 


Consider now the other series (10). By (41), the limit of the ratio of successive values of (34) is, for 
0 < pis < 3 
lim Soyso(Pr2) _ 1 


= 1. (43) 
poo %y,(Pr2) 
Thus, by the ratio test, we find that (10) converges everywhere in the range, 
0 < Pas < 1, 
0 <p}, <1 (44) 
0<ps<1 


We can show that the series also converges when p33 = 1, as in § 2; therefore, by a property of power 
series, we may establish uniform convergence near p2, = 1. 
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On a problem connected with quadratic regression* 


By R. G. LAHA anp E. LUKACS 
The Catholic University of America, Washington, D.C. 


1. Introduction. We consider two random variables X and Y and denote by E(Y|X) 
the conditional expectation of Y given X. We say that Y has polynomial regression of 
order k on X if the relation 

E(¥|X) = fot By X+...+ 2, X* (1-1) 
holds almost everywhere. We assume that the first moment of Y and the moment of order 
k of X exist. It follows from (1-1) that 

E(Y) = £y+ fh, E(X)+...+ 6, H(X*). (1-2) 
If k = 2 and £, + 0 (k = 1 and f, + 0) then we speak of quadratic (linear) regression. 
If k = 0, that is if H(Y|X) = E(Y) almost everywhere, then we say that Y has constant 
regression on X. The coefficients fo, /,, ..., A), are called the regression coefficients. 

Let X,, Xo, ..., X,, be asample of size n (independently and identically distributed random 
variables) from a population with distribution function F(x). We write 

A= X,+X_4+...4+X, =nX 
for the sum of the observations and S = S(X,, X,,..., X,,) for another statistic. In many 
cases we know that it is possible to find a statistic S which has constant regression on A. 
Conversely, this property determines sometimes the population. 
In the present paper we consider a quadratic statistic 
n n n 
Q= YY a,;X,X;+ Y 0; X; 
i=1j=1 j=1 
and study all the populations which have the property that Q has quadratic regression on A. 
It will be necessary to distinguish several cases which are defined in terms of relations 
between the coefficients a,; and b; of Q and the regression coefficients £y, £,, 2,. In each of 
these cases we show that the population is characterized by the property we mentioned. 

We note that we consider here only a quadratic statistic which does not reduce to a linear 
form since it can be shown easily that every linear form S b; X; has linear regression on A. 

j=1 

In § 2 we derive a fundamental lemma concerning polynomial regression; in § 3 we obtain 
a differential equation for the characteristic function of the population. Sections 4 and 5 
deal with the solutions of this equation and contain the results. 


2. Two lemmas. We give first a condition on polynomial regression. 
Lemma 1. Let X and Y be two random variables and assume that the expectations 


E(Y) and E(X*) exist where k is a non-negative integer. The random variable Y has poly- 
nomial regression of order k on X if, and only if, the relation 


k 
E(Ye#X) = E(X’ ctX nie 
holds for all real t. ( ) ze ( ) (21) 


* This work was supported by the National Science Foundation. 
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If one multiplies (1-1) by e** and takes the expectation then one sees immediately that 
condition (2-1) is necessary. 

To prove the sufficiency of the condition we assume that (2-1) is valid for all real ¢. Then 


slelr-ax]- 
or a ce Y- = pez*\2) dF,(x) = 0. 


—0 


Here F,(x) is the marginal distribution of X. We introduce here the probability function 
PA) of the random variable X instead of the distribution function F(x). This is a set 
function defined on all Borel sets of R,. The preceding equation becomes then 


k 
i etn (Y— p » faa") aP, = 0. 
Ry v=0 


k 
Let “(A) -| B(Y -> pez) dP. This is a function of bounded variation which is 
A v=0 
defined on all Borel sets A of R, and we see that 


| edu = 0. 
Ry 


Since the uniqueness theorem for characteristic functions is valid for the Fourier transforms 
of functions of bounded variation we conclude that ~(A) = “(R) = 0 for all Borel sets A. 


k 
This is only possible if Z (y -> pe2*|x) = 0 almost everywhere, so that the lemma is 
proven. pee 


We next prove a lemma which is needed in § 5. 


Lemma 2. Let a, p and A be three real numbers and suppose that p > 0. The function 
f(t) = [cosh at + iA sinh at}-? 


is then an infinitely divisible characteristic function. 


The statement of the lemma is trivial if a = 0, it is therefore no restriction to assume 
that a + 0. 


We consider the function 
y(z) = cosh az + 7A sinh az (2-2) 


of the complex variable z = t + iy (t, y real). We see from (2-2) that y(z) is an entire function 
of order 1; the zeros of y(z) are the solutions of the system of equations 
(e* + e-*) (cosay —Asinay) = 0, (2-3-1) 
(e* — e-%) (sinay +A cosay) = 0. (2-3-2) 
Equation (2-3-1) has the solutions 


¥, = ; (eretan 5 + kn) (kK = 0, +1, +2, ...), (2-4) 


while the only real solution of (2-3-2) which is compatible with (2-4) is t = 0. The zeros of 
y(z) are therefore given by 


. 


&=y, = ~ (arctan; +k2) (k = 0, +1, +2, ...) (2-5) 


an 
ar; 


tk 


at 


len 


ion 
set 


_ is 


me 


2) 
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1) 


+2) 


+4) 


| of 
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and are thus purely imaginary. We note that y(z) is real for purely imaginary values of the 
argument. It follows then from Hadamard’s factorization theorem that 


y(t) = e* TT (1 + ) exp (- ) ; (2-6) 
k Yk Yk 
where ¢ is a real constant and where the y,, are given by (2:4). 

We conclude from P. Lévy’s continuity theorem that 1/y(t) is a characteristic function, 
as a limit of infinitely divisible characteristic functions 1/y(t) is necessarily infinitely divisible 
so that the statement of the lemma is established. 


3. The differential equation for the characteristic function. Let X,, X>,...,X,, be a sample 
of size n from a population with distribution function F(x) and assume that the second 
moment of F(x) exists. We denote by 


fit) = | * ete dF(e) 


the characteristic function of F(x). We consider a quadratic statistic 
n n 
Q= LX aj,X,X;+ ¥ 5X; 
i,j=1 j=1 


and suppose that Q has quadratic regression on A = > X; so that 
j=1 


E(Q\A) = Bot Bi A+ fA? 
almost everywhere. It follows then from Lemma 1 that 


E(Qet#) = By H(c#A) +B, E( et) + fy H(A2e#A) (31) 
holds for all real ¢. 


We denote in > iar : rn 
al 


v 


~ 
s. 
ll 
-_ 
v. 
I 
-_ 


In a certain neighbourhood of the origin f(t) is different from zero so that we can introduce 
d(t) = Inf(t). Then 





FO _ gy ana £ - gator. 


fl) ~ fi) © 
We obtain, by means of some elementary computations, the relations 
EB(Qe") = —[f()]" {419"(t) + (A, + Aa) [d'(OP + Bid'()} (3-2-1) 
and ioe) + fy E( Ae) + fy E( Ate) 


= —[fOM {nP.b"(t) + n*Bld'()P + nB,id'(t) - Bo}. (3-22) 


These relations are valid in the neighbourhood of the origin in which ¢(¢) is defined. We see 
from equations (3-2-1), (3-2-2) and (3-1) that 


19" (t) + yal’ (HP + t73'(t) = Po; (3-3) 
where 1 =7f,—-A,, Yo=n*B,—A,—Ay, Y¥3= np, —B. (3-4) 
It is convenient to introduce the function 


A(t) = (1/t) o'(t). (3-5) 
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Equation (3-3) can then be written as he 
. dO 
N17 = V2? +739 + Bo (36) | 
where we wrote @ for 6(t). It follows from (3-5) that 
7 P 
A(0) = (1/t) 6"(0) = & (3-6-1) T 
do 1 
aa = —" - ¢ 2 6-2 
and 4 ay $"(0) = io (3-6-2) 
Here a and o? are the mean and the variance respectively of the distribution F(x). We put w 
t = 0 in (3-6) and obtain the relation | in 
ec 
— OY, = Yo%? +Y3a+ fo (3-7) 
bet ween the coefficients of Q and the regression coefficients. It would also have been possible | . 
to obtain (3-7) from equation (1-2). This is a consistency condition which must be satisfied. 
Our next aim is to obtain all the solutions of equation (3-6). For this investigation we T 
must consider several cases. (i 
We need not concern ourselves with the possibility that all coefficients y,, y2, y3 vanish. 
If y, = 0 while at least one of the coefficients y, and y, is different from zero then we see 
that O(t) and ¢’(t) are constants so that we obtain a degenerate distribution. We can, 
therefore, assume without loss of generality that y, + 0. 
In § 4 we discuss the case y, = 0. Here we have to study separately the cases where 
1+9, ¥2=9, Yg=0 (3-8) a 
and %1+0, ye=90, Ye +9. (3-9) 
In §5 we deal with the case y, + 0 and must distinguish three possibilities which depend | f 
on the sign of the discriminant A = y3—4y,>. | 
4. The case y, = 0. We first investigate the case (3-8) and prove the following theorem. f 
e 
THEOREM 1. Let X,, Xo,...,X,, be a sample of size n taken from a population which has 
a finite variance o”. Consider a quadratic statistic 
fi 
n n 
i,j=1 j=1 
such that A = A,(n—1)—A, + 0, (4-1) 
. 
n n 
i=1 i,j=1 
i+j 
Let /, and /£, be two real constants such that 
B >) 
n j=1 3 
I 


fy = (A, +49). (4-2-2) 


The relation E(Q\A) = fo + hi A+ PA? (4:3) 





as 


2) 
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holds almost everywhere if, and only if, the following two conditions are satisfied 
2 
(i) ~yp =A =; (ii) the population is normal. 


We first note that the relations (4-1), (4-2-1) and (4-2-2) are equivalent to (3-8). We first 
prove that the conditions (i) and (ii) are necessary and assume therefore that (4-3) is satisfied. 
The differential equation (3-6) for 6(¢) reduces in view of (3-8) to 


. dO 

"ta Bo: (4-4) 
we put here ¢ = 0 and use (3-6-2) to show that £, = —y,0?. Condition (i) follows then 
immediately from (3-4) and (4-2-2). We integrate equation (4-4) for O(t) with the initial 
conditions (3-6-1) and (3-6-2) and obtain 

P(t) = —407t? + iat, 

or f(t) = exp [-— 40°7#? + iad]. 
This is the characteristic function of a normal (possibly degenerate) distribution so that 


(ii) follows. 
To prove the sufficiency of condition (4:3) we assume that the population is normal so that 


f(t) = log f(t) = — 4070? + iat. 
It follows then from (3-2-1) and (3-2-2) that 
E(Qe"4) = —[f(t)]" {0*(A, + Aq) # — 0°[2a(A, + Ay) + B]it— A, o* — Ba —a(A, + A,)} 


(4-5-1) 
and fyB(el*) +p, E(Ae") + fy B(A? et) 


= —[f()]" {o'n? ft — o?[2an*f, + fyn]it—py—apn—nf.o? —n?a7fy}. (45-2) 
In view of (4-2-1), (4-2-2) and (i) we see from (4-5-1) and (4-5-2) that . 
B(Qeltd) = fy E(t) + By H(A ce) + By (A264) 


for all real ¢. We conclude then from Lemma 1 that (4-3) holds almost everywhere. We must 
examine the case where (3-9) holds and prove the following theorem. 


THEOREM 2. Let X,, Xo, ..., X,, be a sample of size n taken from a population which has 
finite variance o?. Consider a quadratic statistic 


Q= DY ajX,X;+ Y 5X; 


i,j=1 j=1 
such that condition (4:1) of Theorem 1 holds. Let £, and /, be two real constants such that 


Ai + : (where B= > »)), (4-6-1) 
j=1 
1 
pb. = ne (A, +Ay). (4-6-2) 
The relation E(Q\A) = fo + Pi A+ fA? (4:3) 


holds almost everywhere if, and only if, the following three conditions are satisfied: 
(i) the population has the Poisson type characteristic function 


fit) = exp [A(e—1) + int], 
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where A > 0, p + 0 and vy are three real constants, 
= A 7 1 
(ii) Ay= a, (iii) A, = 73 (Ap +B). 
Here the relations (4-1), (4-6-1) and (4-6-2) are equivalent to (3-9). To prove the necessity 


of conditions (i), (ii) and (iii) we assume that (4-3) is satisfied. The differential equation (3-6) 
for 6(t) becomes then 


. ad 
17 = ¥39 + Bo. (4:7) 


We integrate equation (4-7) with the initial conditions (3-6-1) and (3-6-2) and obtain 


2 
d(t) = ae fexp (—tyst/y) — 1} —Pet. 
3 Ys 


We write A= oe (4-8-1) 
Y3 

ee. 2 4-8-2 

p 7, ( ) 
Bo 

i= — 4°8°3 

} ve ( ) 


and obtain the Poisson-type characteristic function (i). We see then easily from (3-4), 
(4.6.2), (4.8.2) and (4.8.3) that (ii) and (iii) are satisfied. 

To prove the sufficiency of (4-3) we assume that the characteristic function of the popula- 
tion is given by (i) and that f, and /, are defined by (ii) and (iii). We see from (3-2-1) and 
(3-2-2) that 

E(Qe"*) = [f(t)]" {p?A?(A, + Ag) e+ pA[pA, + 2u(A, + Ag) + Ble’ + u2(A, + Az) + By}, 

(4-9-1) 

Bo H(e"4) + B, B(Ae*4) + fy E(A? e#4) 

= [f(Q)]" {(p?A?n?p, c+ pA[n fy + 2un*Py + Bin] ei + By + Pynwt+pn*B,}. (4-9-2) 
We use the relations (4-6-2), (ii) and (iii) and Lemma 1 to show that (4-3) holds almost 
everywhere. 


5. The case y, + 0. Our next theorem deals with the case where y, + 0 while 
A = ¥5—472h > 0. 
THEOREM 3. Let X,, X3,..., X,, be a sample of size n taken from a population with finite 
variance o?, Consider a quadratic statistic 
n n 
Q= YX a;X;,X;+ ¥ 5X; 
i,j=1 j=1 


such that condition (4-1) holds. Let fo, 8, and f, be three real constants such that 





fa 5s, (51-1) 
(nf, —B)? > 48,(n*8,—A,—Ay,), (5-1-2) 


where B= > b;. 
j=1 


Th 


ho 


th 
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The relation 
E(Q\A) = Po t+ fy A+ fA? (4:3) 


holds almost everywhere if, and only if, the following four conditions are satisfied: 
(i) The population has the characteristic function 


fi) =[pe+qe])e (pt+q=1), 


(ii) 2o= _ PAM Me (iii) ~, = B  pA(ty+ 2) 


4 A,(p—1)+Agp 
np—1 ’ n n(np—1) . 


, (iv) A,= n(np — 1) 





Thus, the population is either a binomial population (if p is a positive integer, then neces- 
sarily p > 0, g > 0) or a negative binomial population (if p < 0 then pq < 0). 

We prove first that condition (4-3) is necessary. It follows from (3-4), (5-1-1) and (5-1-2) 
that y, + 0 and A = y3—4y,f,) > 0. Since A is the discriminant of the quadratic form 
20? +30 + By one can write the differential equation (3-6) for O(t) in the form 


. dO 
1a = Ye9—M) (8-2), (5-2) 


where 7, and 7, are both real and 7, + 42. We integrate first this equation, then the equation 
which results from (3-5) and use the initial conditions (3-6-1) and (3-6-2). In this way we 


— V11,,{%-% V2.4) %-9 oY 
t) = “'In a ex (72 it a (22% it)! , 
et!) Ye \N-%e P V1 Ii Ne ° V1 
. a—Ns a—y 
If we write t) = ex t and =——-, q=-——, 
f(t) = exp[9(t)] hg cer te 
am? «2a uae 
” V1 “7 N° . Ye 


we see that f(t) has the form specified in (i). 
We putt = 0 in (5-2) and see, using (3-6-1) and (3-6-2) that —o%p = (~a—7,)(a—7,). From 
this it follows easily that p > 0, q > 0 in case p > 0 while pq < O if p < 0. We note that 


V3 


M+%,=-—- and 1% = Po. 
Ye 


Y2 
Using these relations and the formulae defining /,, “. and p as well as (3-4) we can derive 
the expressions (ii), (iii) and (iv) for fy, £, and /,. 

To prove that our conditions are sufficient we assume that the popuiation has the charac- 
teristic function specified by (i) and that £,, 6, and /, are given by (ii), (iii) and (iv), respec- 
tively. We proceed then as in the proof of Theorem 2, and can show that (4-3) holds almost 
everywhere. 

We consider next the case where A = y3—472/, = 0 and prove the following theorem. 


TuroreEM 4. Let X,, X2,...,X, be a sample of size n taken from a population with finite 
variance 0”. Consider a quadratic statistic 


n n 
Q= DY aj,X;X;+ Y O;X; 
ij=1 jut 
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such that condition (4-1) holds. Let fo, £, and f, be three real constants such that 


By + 54 R (5-3-1) 
(2, —B)® = 48o(n2B,—A,— 2), (5.3.2) 

where B= z b;. 
The relation E(Q\A) = yo +f, A+f,A? (4:3) 


holds almost everywhere if, and only if, the following four conditions are satisfied: 
(i) The population is a Gamma population with characteristic function 


ft) = e#(1- =)" (p > 0, a+ 0), 


24 os B A 
(i) 2=+ oe 


com a... A,(p+1)+ Asp 
np+1? n mn(np+1)’ 


We see from (3-4), (5-3-1) and (5-3-2) that y, + 0 and that A = y3—4y.f, = 0. Since A 
is the discriminant of the quadratic from y,67 + y,4 + 2) we can write the differential equa- 
tion (3-6) for A(t) in the form do 
yy a Y2o(9—0)?, (5-4) 


where 7 is real. To prove that condition (4-3) is necessary we solve this equation and deter- 


mine then f(t) and obtain / 
fi) = etn 1 é (a “en it] wd 


1 
We put ¢ = 0 in (5-4) and see that 


y? 2 
. Y1 V1 
If we write a, = = y =, 
ky ya—y BO" 
then we see that f(t) has the form specified in (i). We note that 
Bo 2 V3 
= and “*=—2y. 
Y2 . Ye ' 


From these relations and from (3-4) we get easily the expressions (ii), (iii) and (iv) for fo, 


A, and f,. 


The proof of the sufficiency of our conditions is given in the same way as in the preceding 
theorems and is therefore omitted. 
Finally, we consider the case where A = y3—472/ < 0 and prove the following theorem. 


THEOREM 5. Let X,, Xq,..., X,, be a sample of size n taken from a population with vari- 
ance o?. Consider a quadratic statistic 


Q= DY a,;X,X;+ Y 0X; 
i,j=1 j=1 


su 


er 


te 


Bo, 


ri- 
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such that condition (4-1) holds. Let fo, 8, and f, be three constants such that 


Bo + aia, (5-5-1) 
(np, — BY? < 48,(n%By—A,— Ay), (5-5-2) 

where B= ¥ by. 
The relation E(Q\A) = Po iA + By A? (4:3) 


holds almost everywhere if, and only if, the following four conditions are satisfied: 
(i) the characteristic function of the population is given by 
f(t) = e [cosh at + iA sinh at]-?, 
where a, A, 4, p are real constants and p > 0, a + 0, 
A(x? + p*a?) 


“4° ,:lC(ié‘é kat 2Au 


; ae. A,(l+p)+pAs 
np+1 n n(np+1)’ ‘ 


) A= 


We see from (3-4), (5-5-1) and (5-5-2) that y. + 0 and A < 0. We can then write the differ- 
ential equation (3-6) for 6(¢) in the form 


. ab . 
Ya, = Yl9—1) (0-7), (5-6) 
where 7 = “+t, 7 = w—tv (py, v real). We determine f(t) from this equation and obtain 
Ye 
f(t) =e [cosh . 244 4Asinh 2? ‘| 
; 1 


V1 
We put ¢ = 0 in (5-6) and see that 


ve = o? < 0 
We write pa wit >h en 
Ye v1 
and see that f(t) has the form specified in (i). We note that 
= Ys a he 
+97 =-— and wH=—. 
a Ye Ye 


From these relations and from (3-4) we get easily (ii), (iii), and (iv). 

The proof of the sufficiency of our conditions is given in the same way as in Theorems 1, 
2 and 3. 

In conclusion we note that Tweedie (1946) considered earlier the regression of the sample 
variance on the sample mean. He obtained particular cases of some of the theorems of the 
present paper. The authors are indebted to Mr Tweedie for calling their attention to his 
paper. 
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Small sample behaviour of certain tests of the hypothesis 
of equal means under variance heterogeneity* 


By ROGER S. McCULLOUGH, JOHN GURLAND 
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anD LLOYD ROSENBERG 
Department of Mathematical Statistics, Columbia University 


SUMMARY | 


By using a finite series representation of the distribution of a certain class of statistics, 
and by utilizing other techniques presented here, two types of statistic are developed for 
testing the hypothesis of the equality of the means of two normal populations using small 
sample sizes. One type of statistic, called unilateral, effectively controls the size of the test 
under variance heterogeneity if it is known a priori that the variance of one specified 
population is greater than that of the other. The second type of statistic, called bilateral, 
controls the size when there is no a priori knowledge of the population variances. Tables are 
included specifying both types of statistic and giving size and power. 


1. INTRODUCTION 


Suppose X, and X, are two independent Normal random variables with means y, and p, 
and variances o7 and o%, respectively. Samples of sizes n, and n, drawn from the corre- 
sponding populations are denoted by 2;;(¢ = 1,2; 7 = 1,2, ...,m,). It is desired to test the 
hypothesis H): “, = , (without assuming of = 0%), and the problem is to find a statistic for 
making this test which has optimal properties in some sense. The usual functions of the 
samples are defined as follows 

ni ni 
t= ~ Ux%y, B= DY (ej—%,)?. (i = 1,2). (1) 
ij=1 j=l 
Also let the parameter R denote the ratio o%/03 of the true population variances. R can, of 
course, take on values from zero to infinity. 

The effect of variance heterogeneity on the distributions of certain statistics used in 
testing H, will be investigated for the case of small sample sizes 3, 5, 7 and 9. These sample 
sizes are convenient in the application of the finite series expansion employed here, but 
larger sample sizes could also be treated by the same technique. 

Welch (1937, 1947) has considered the above problem, and the following statistics for use 
in testing H, are discussed in his second paper. They are squared here for simplicity. 








___—@,-3,) 
mn (ho 2) See ” 
Ny Np] Ny +Ng— 2 
ce (%,—Z,)* 3 
' , a ie ” 
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(%,—2,)* 
__2a _,_ 2s 
M4(Ny—3) Nq(N_— 3) 
Chand (1950), Gronow (1951) and Hsu (1938) have examined some of the properties of 
the wu and v statistics and have tabulated size and power for a few special cases. 
It was suggested in Welch (1937) that a statistic of the general form 





2= (n, > 3, > 3). (4) 


(%,—%,)? 


Y(r1,%2) = 1D, +1229" (5) 


where 7, and 7, are constants appropriately chosen, might be considered in attempting to 
control the size of the test for different values of R = 03/03. It is obviously possible so to 
choose r, and r, that the hypothesis H, is rejected only when Y(r,,72) > 1; this choice will 
always be made in the present paper. The distribution of (5) under H, is that of 





ity bhi (6) 
AX}, + Aa XG, 
where fp=m—-l, A= = and A, = Tae 
my My My Ng 


and all the y? variables are independent. Under the alternative hypothesis ~, + 2, the 
distribution of (5) is that of 
Xia 
STE (7) 
Ay XF 1 + Ay Xi 2 
where the variables are independent, and the numerator is a non-central x? with one degree 
of freedom, and non-centrality A given by 





ly — te)” é\? nn 

i bt = (=) ie (8) 
1, % o,) ny +Rn, 
N, Ng 


where 6 = ty — flo. 

Our attack on the problem is similar to that of Welch (1937) but differs from that of 
Welch (1947). We consider the class of statistics (5) and examine the size and power for a 
fixed critical point (namely unity). In Welch (1947) the corresponding critical points are not 
fixed but are functions of the sample variances. Ura (1955) has studied the power of the test 
considered by Welch (1947) and elaborated by Aspin (1949), in the case of equal sample 
sizes. Wald (1955) has proposed a statistic in the case of equal sample sizes which also uses 
a random critical point that is a function of the sample variances. 

In the present article we treat separately two kinds of statistic, those with unilateral and 
those with bilateral control of size. The first kind, called unilateral, is used if it is known 
a priori that the variance of one specified population is greater than that of the other. This 
statistic keeps the size of the test less than or equal to a given value over the relevant range 
of R > 1. The second kind, called bilateral, is used when there is no a priori knowledge of the 
population variances. It keeps the size less than or equal to a preassigned value over the 
whole range of R. For the unilateral case, all pairs of sample sizes 3, 5, 7 and 9 are con- 
sidered (see Table 1), and size and power are given (see Tables 2 and 3). For the bilateral case 
it is shown how tables of the percentage points of Student’s t may be used to find the appro- 
priate statistics for any pair of sample sizes. 





aoeoaenee ee 


(4) 


the 
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2. TECHNIQUES FOR EVALUATING THE REQUIRED PROBABILITIES 
2-1. Calculation of the size of the critical regions 


To calculate the size of the test using (5), it is necessary to evaluate probabilities of the 
_— P{¥ (ry) > 1] RB}, (9) 


where # isa constant. For specific values of n,, 2,7, and r, and for Y distributed as (6), the 
size given by (9) can be plotted against R. Some graphs for the case n, = 3, n. = 5 and for 
selected r, and r, are given in Fig. 1. It should be noted that the curves approach horizontal 
asymptotes as R — 0 (i.e. 7, > 0) and R > 0 (i.e. 7, > 0). In these two extreme cases the 
statistic Y(r,.r,) has the following structures. 


—_ 








for R=0 10 
Neto X}, (10) 
2 
and xi 5 for R=o. (11) 
MTX, 


To evaluate probabilities corresponding to (10) and (11) it is convenient to transform to the 
Incomplete Beta Function as follows. 


ua Gun(e) = PL > ¢}, sa 
where the yx? variables are independent. Then 
En, m(c) = L,(4m, $n), (13) 
where oe _ 
and I,(a,b) = ad I X ate 5 ~t)-1 dt. 


The Incomplete Beta Function J,(a,b) was tabulated in Pearson (1934). If G,,,,(c) has the 
value a, then c can be written as 


c = (t;,)?/m, (14) 


where ¢@, is the two-sided a °4 point of Student’s ¢ with m degrees of freedom. 
In computing probabilities of the general form (9), use was made of the following theorem. 


THEOREM 1. Let Y be a random variable with the structure 
Xn 
Y= aes (15) 
Ay Xt. + 2Xp, 


where the x? variables are independent, the f; = 29; are even integers, and the A, are positive 
constants. Then the distribution function of Y is given by 


2 
Fy(y) = > Bap Fa rAd) (16) 
j=1s8= 


where F, ,,(x) = 1—G,, »(x). The constants a,;,are given by 


P'(9i+92—8) ApeaAgr* 
= (— 1)%1-§ —_— ns eet a = 2, ¢ b wy ° 1 
ae P(g) P(g, —8 +1) (Ay — Ag) +2 (s = 1, 2,3, ....91) (17) 
a2 Biom. 47 
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Pe G.—8 ) 9, 
Oa, = (—1)%-* _TWitge—s) AN *AR 


T'(gs) P(g2—8 + 1) (Ag—Ay)402-* 





(s = 1, 2,3, ..., ge). (18) 


The above theorem follows easily from the distribution of a linear combination of x? 
random variables with even degrees of freedom (cf. Box (1954), Theorem 2-4). This theorem 
although not stated as such is available in Hsu (1938) and Chand (1950), and has been used in 
computing the sizes of the various tests described in §3. 


2-2. Calculation of the power of the test 


In computing probabilities required for the power of the tests proposed, use was made of 
the following theorem. 


THEOREM 2. Let Y be a random variable of the distributional form 





y = Xe (19) 
AKG, tAaXF,’ 


where the y? variables are independent, and the numerator is a non-central x? with non- 
centrality A. Then Y has the distribution function 


2 05 ee) Ar 
Fy(y) = a) 2 Me pT or tn+2r,2elAyy), (20) 


where notation is the same as in Theorem 1. 
This theorem follows easily from Theorem 1, and has been used by Chand (1950) and 
indirectly by Hsu (1938). 


3. DETERMINATION OF OPTIMAL STATISTICS 
3:1. Statistics with unilateral control of size 


In using the wu, v? and z? statistics defined by (2), (3) and (4), the critical values of the tests 
were so chosen that the size of each test was exactly equal to the preassigned value a when 
R = 1 (i.e. o, = 04). 

When the case n, = 3, n. = 5is used as an example it is found that Welch’s condition that 
Ez have equal values at R = 0 and R = oo is inapplicable. Therefore a modified 2? statistic 
with r, = 1-5840 andr, = 0-2375, which gives E |z| equal values at R = Oard R = 0, is used. 
As can be seen from the graphs in Fig. 1, the curves become flatter in the region R > 1 
as r, increases and so r, decreases, up to a certain point. For the particular values 
r, = 30855, r, = 0-0822, the size has an asymptotic value of 0-05 as R — oo, and is only 
slightly less than 0-05 for the entire range 1 < R < oo. This statistic can be extremely useful 
if it is known that 0? > o3. For example, the populations might consist of measurements 
made by two different techniques, a particular one of which is known to be more precise 
than the other. Such information is utilized by this statistic in keeping the size practically 
constant over the relevant range of R > 1. Such a statistic is called a unilateral statistic. It 
can be looked upon as optimal within the class (5) because no other statistic in this class 
keeps the size as nearly constant and also < a for R > 1. 

Unilateral statistics can be found for all combinations of sample sizes from the following 


two conditions P{¥(r,,72) > 1|R =} = | 


(21) 
P{Y(r,,r2) > 1] R = co} =a. 
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Fig. 1. Size curves corresponding to tests using several statistics (as shown in the table) for the case 
n, = 3,n, = Sanda = 0-05. 
Guide to curves 
und Curve Statistic 
number used T; YT. 
1 —_ 0:2773 0-6932 
2 u2 +5322 +5322 
3 v 1-1007 +3322 
4 z? (modified) 1-5840 2375 
- 5 Unilateral 3-0855 -0822 
ae 6 Bilateral 3-0855 “3854 
hen 7 — 3-8690 -0387 
hat The second equation can be written 
‘ xz 
stic P{% > rm| =a 
ed. fi 
. : (t? )? 
>1 and from this we get directly n=. (22) 
mh, 
ues 
nly The parameter r, can be written as f= -. (23) 
ful Neofe 
nts and ¢ is given in Table 1 for the cases « = 0-05 and a = 0-01, and sample sizes 3, 5, 7 and 9. 
cise In Table 3 the power is given, as in Gronow (1951), as a function of 3/0, for convenience. 
ally The three values of d/o, were chosen to give power near 0-3, 0-6 and 0-9 in order to have a 
. It more extensive picture of the relationship of 5/a, to power. 
lass The power of the test using the unilateral statistic can be compared with the power of an 
analagous t-test in which the ratio of variances is assumed to be known. A ??-statistic that 
ing could then be used for testing H: “4, = 2 is 
u2 = (%,—%,)* (24) 
21) Ro %,/R+ Xe (2 1) 
\ ee | +- — 
Ny, + No — 2 Ny No 
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Under A), uj, is distributed as ¢7, ,,,, » wheret is Student’st. Under the alternative hypothesis 
the distribution is that of a non-central F with non-centrality A given by (8). 

The power of the test using u7, has been computed using Tang’s (1938) tables for the same 
values of d/o, and F as for the unilateral statistics. It appears that although the power of the 
t-test is always the greater, in many cases the difference is inconsequential. 


3-2. Statistics with bilateral control of size 
If it cannot be assumed that one specific population variance is greater than the other, 
then all values of R must be taken into consideration in constructing a statistic which 
controls the size. On examining the curves in Fig. 1 it is evident that there are curves in the 
family for which the probabilities are equal at R = 0, and R = oo. By altering the para- 
meters r, and r, suitably, this probability can take any desired value. 
Since practical considerations suggest that the size of a test be kept less than or equal to a 


preassigned value, it can be seen that the statistic whose parameters are defined by 
P{Y(r,,72) > 1|R = 0} = _ (25) 
P{Y (11,72) > 1|R = co} =a. 


is the best in the class of statistics considered when nothing is known about R. Such statistics 
will be called bilateral. From (25) we can get values for r, and r, directly for all n, and n, and 
for any value of « using tables of Student’s ¢: 


= (Bah 


(26) 
1, = (tf)? /Neofe. 


4. USE OF THE TABLES 


The following example will illustrate how the ¢ values given in Table 1, and a set of 
t-tables, are used for tests involving the unilateral and bilateral statistics. Suppose there 
are two Normal populations as described in §1, but it is known a priori that o, > 3. It is 
desired to test Hy: 4, = , at the 5 % level, and a unilateral statistic would be appropriate. 

A sample of size 5 is drawn from the first population and of size 9 from the second 


(n, = 5, n, = 9). 
The sample means and sums of squares of deviations are as follows: 
%,=2:9, D,=15:0; %,=0-2, Z, = 30-0. 
Using a unilateral statistic it is found from (22) and (23) that 


= (27764)? 
—— 
The value of the statistic is 


= 038542, r, = as = 003653. 


pe eink = .. se en 
(0-38542) (15-0) + (0-03653) (30-0) 
and H, is rejected. 
If we were to ignore the information that 7, > o, and use a bilateral statistic the values 
of the constants would, from (26), be 


r, = 0-38542 and rz = 0-073856. 
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sis The value of the statistic is 

(2-7)? ee ees aoe dae 0-91 
ne (0-38542) (15-0) + (0-073856) (30-0) — 
» and H, is not rejected. 


It is noted that if the information that R > 1 is ignored, it is possible to arrive at a different 
decision than if the information is used. 











‘ ’ Table 1. Constants for unilateral statistics 
ch 
D.F. d = Nefers 
he ve: . 7 ee. 
‘a- th fs Test size 0-05 Test size 0-01 
2 2 2-327 2-682 
ya 2 4 1-644 1-836 
2 6 1-444 1-597 
2 8 1-395 1-477 
5) 4 2 5-468 9-600 
4 4 3-337 4-886 
| 4 6 2-849 3-953 
i 4 s 2-630 2-630 
id 
6 2 7-668 17-976 
6 4 4-304 7-360 
6 6 3-607 5-733 
6) 6 8 3-309 5-068 
8 2 9-222 26-040 
8 4 4-910 9-374 
8 6 4-029 7-568 
of 8 8 3-719 6-089 
re 
is Table 2. Values of size for unilateral statistics 
» DF. a = 0-05 a = 0-01 
poke ey —— Sh — a . 
hh i, R=1 R=4 R=10 R=100 R=a0 R= R=4 R=10 R=100 R=0 
2 2 005 0-:0450 0-0465 00494 0-05 0-01 0-0088 0:0092 = 0-:0099 =0-01 
2 + 05 -0479 -0487 -0498 “05 0-1 -0095 -0097 -0100 ‘01 
2 6 -05 -0488 -0493 -0499 -05 ‘01 -0098 -0098 -0100 ‘01 
2 8 -05 -0491 -0495 -0499 -05 ‘01 -0098 -0099 -0100 01 
4 2 0-05 0-0389 0-0407 0-0482 0-05 0-01 0-0065 0-0070 00-0093 0-01 
4 4 05 0453 -0469 -0495 “05 ‘01 -0085 -0090 -0098 ‘01 
+ 6 ‘05 -0474 -0484 -0498 “05 ‘01 -0092 -0095 -0099 ‘O01 
4 8 -05 -0483 -0490 -0499 05 ‘O01 -0094 -0097 -0100 ‘01 
6 2 0-05 0:0357 0:0364 0-0466 0-05 0-01 0-0052 0-0051 0-0084 0-01 
6 4 -05 -0433 -0451 -0492 -05 ‘01 -0076 -0081 -0097 ‘01 
6 6 -05 -0461 -0475 -0496 -05 ‘01 -0086 -0091 -0099 ‘01 
6 8 -05 -0475 -0485 -0498 05 01 -0091 -0094 -0099 01 
les 8 0-05 0:0342 0:0335 0-0451 0-05 0-01 0:0046 00-0041 00074 0-01 


2 

4 05 -0412 0435 -0489 05 ‘01 -0068 0074 -0095 “01 
8 6 05 -0454 -0467 -0495 05 ‘01 -0076 -0084 -0097 ‘01 

8 -0468 -0479 -0497 05 ‘01 -0087 -0092 -0099 ‘O01 
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Table 3. Power of tests using unilateral statistics (a = 0-05) 








D.F. 

SS R=1 R=4 R= 10 
fi Se P A athe et A bl oe ae eee ees 
2 2 (a) 1-53 2-45 4-00 2-89 4-83 7-07 4-69 7-66 11-33 
(b) +27 “54 -88 -28 “58 +84 -30 “59 “85 
(c) +30 -62 95 -40 -80 -98 “47 “84 -99 
2 4 1:50 2-83 4-00 2-82 4-95 7:33 4-68 7-75 11-89 
+29 -68 “89 -28 -61 “86 -31 -60 -88 
-41 -90 -99 “47 -91 1-00 “55 93 1-00 
2 6 1-51 2-67 4:10 2-85 5-43 7-68 4:72 8:34 11-79 
-30 65 91 -29 67 “89 31 65 “87 
“45 -96 1-00 -54 97 1-00 -60 -97 1-00 
2 8 1:65 2-83 4-32 2-94 5:76 7-60 4-73 8-90 11-74 
-31 63 -89 -31 “72 -88 31 -70 -87 
-61 97 1-00 -60 -99 1-00 63 -99 1-00 
4 2 1:16 1-93 3-27 1-99 3-19 4-76 3-24 4-58 6-83 
26 59 “95 -30 65 94 37 -63 -92 
27 -60 96 +35 ‘71 96 -43 ‘71 -96 
4 4 1-02 1-79 2-83 1:90 3-16 4-47 3-18 4-45 6-63 
-29 -69 “97 -33 “71 94 “39 -64 -92 
-30 -70 97 “39 +80 97 “47 “75 -97 
4 6 0-98 1-55 2-62 1-89 2-57 4-34 3-20 3-87 6:55 
31 62 -96 +34 “55 -93 -40 “E -92 
+34 -66 -97 43 66 -98 51 36 -98 
4 8 0-97 1-58 2-49 1-91 2-86 4:29 2-91 4:59 6-50 
31 67 -96 “35 65 93 +34 -68 +92 
-36 “74 -98 45 78 -98 +45 -82 -98 
6 2 1-20 1:83 2-68 1-65 2-52 3-68 2-30 3-51 5-14 
29 56 “84 27 56 -88 -28 “57 “89 
+34 “64 -92 +34 -64 -92 “34 -64 -92 
6 4 0-83 1:37 2-03 1-39 2-24 3-17 2-21 3-50 4:78 
+25 “56 “87 27 “59 “88 31 “64 “89 
25 56 “88 -30 63 -90 -36 -69 -92 
6 6 0-72 1:31 1-85 1-34 2-24 2-93 2:17 3-43 4:34 
-23 -61 “89 -28 63 “85 31 64 -83 
+24 61 -89 -31 “67 “89 -36 -70 -89 
6 8 0-68 1-24 1:75 1:31 2-26 2-86 2-15 3-51 4-30 
23 61 -88 28 -66 “85 31 67 “83 
+24 62 -90 +32 “71 -90 37 “75 -90 
8 2 0-94 1-76 2-75 1-53 2-33 3-42 2-08 3-18 4-66 
-20 +52 “84 26 “55 -86 -28 “58 -89 
“25 66 -96 -36 -66 94 -36 -66 -94 
8 4 0:79 1:37 2-16 1:39 1:97 3-11 1-98 2-92 4-43 
+25 -60 -93 -33 “58 -93 33 61 “93 
-26 -60 “94 -36 60 “94 36 64 -94 
8 6 0-71 1:13 1:89 1-21 1-88 2-87 1-77 2-96 4:19 
26 “55 94 -29 “60 -92 -29 65 -91 
-26 “BB 94 +32 “62 94 +32 68 94 
8 8 0-67 1-05 1:76 1-18 1-83 2-79 1:75 2-93 4:14 
+26 56 “94 -29 -60 -92 +29 65 -91 
“74 56 94 +32 63 94 +32 -69 94 


(a) Value of 8/c,. 


(6) Power of test using appropriate unilateral statistic. 
(c) Power of corresponding test using u2. 
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Power of some two-sample non-parametric tests 


By BALKRISHNA V. SUKHATME 
Michigan State University and Institute of Agricultural Research Statistics, New Delhi 


1. INTRODUCTION 


The problem of two samples has been considered by several authors from various points 
of view. Most of this work is devoted to testing hypotheses concerning differences in location 
of two populations. A large number of non-parametric tests have been suggested. Particular 
mention may be made of the Wilcoxon test which has been considered by several authors 
especially Mann & Whitney (1947), Lehmann (1951), Sundrum (1953) and Mood (1954). 
Hodges & Lehmann (1956) have shown that the Wilcoxon test is a good competitor to the 
Student’s t-test. However, very little has been done in the direction of testing differences 
in the dispersion of two populations. Recently, attempts have been made by several authors, 
especially Mood (1954), Lehmann (1951), Sukhatme (1957, 1958a), Rosenbaum (1953) and 
Kamat (1956) to suggest suitable non-parametric tests for testing differences in dispersion. 
The tests proposed by the first three authors are based on what are known as generalized 
U statistics and the present author has recently examined the relative efficiency of these 
tests. However, nothing is known concerning the power of the tests suggested by the last 
two authors. This paper is a contribution in that direction and discusses the power of these 
two tests. 


2. WiLKs—ROSENBAUM TEST 


The test is based on the number of observations of one sample, say the X’s, which lie 
outside the extreme values of the other sample. We reject the hypothesis if this number is 
too large. Let X,, X,,..., X,, and ¥,, Y,, ..., Y,, be two samples of independent observations 
drawn from populations with cumulative distribution functions F and G and density 
functions f and g, respectively. In symbols, the test statistic may then be defined as 


W =m— 3 H(Y,X,, ¥™), (21) 
j=1 


where Y® and Y™ are the lowest and highest observations among the Y’s in order of 


magnitude and H(u,v,w)=1 if u<v<uw, (22) 
= 0, otherwise. 


Distribution of W. It is easy to see that 


P(W =r) = n(n—1) (") [re — F(u)]"~ [1+ F(u) — F(v)F 
x [G(v) —G(u)]"- dG(u)dG(v) (2-3) 


for r = 0,1,...,m. 
Putting F = G, we obtain 


P(W.=r)= n(n—1)("") Bom +n—r— 1, r+2) 
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which is the result given by Rosenbaum (1953) and Wilks (1942). To obtain the moments of 
the distribution, we have 


E(W) =m—mP[Y® < X; < Y™) 


= m--mn(n— nf Phi, — F(u)] (G(v) — G(u)]”-? dG(u) dG(v). (2-4) 


var W = var 3 A(Y®, X;, Y™) 
= ES H(Y®,X, Y™) 
+ By H(Y®, X,, ¥™) H(Y®, X,, ¥™) 
- iE > A(Y®, X;, Y™)P. (2-5) 


Now ED H(Y®,X,, ¥™) H(Y®, X,, Y™) 
j+k 


= m(m —1) n(n — nf (LF) -— FMP [E() — Gu)" 2 dG(v) d@(u), 
whence : 


var W = mn(n— »f [F(v) —F(u)] [G(v) — G(u)]}"-? dG(u) dG(v) 
+m(m—1) n(n — »{ [F(v) — F(u)}?? [G(v) — G(u)]"-* dG(u) dG(v) 


—m2n?(n —1)2 _ FO) FIG) — Gwpr* aG(u) acre). (2-6) 


Substituting F = G, we obtain the moments under the hypothesis tested. 


3. KAMAT’S TEST 
The test statistic is defined as 
D=R,,—R, +n, (3-1) 


where R,, and R,, are the ranges of the ranks of the X’s and the Y’s in the combined sample, 
respectively. We reject the hypothesis if D is either too large or too small. 


Distribution of D under the alternative. In what follows, we assume that X’s and Y’s are 
ordered so that a, ee 


Be M Be S ins OE 


As shown by Kamat, the totality of values of D can be built up in four distinct ways: 
(i) R, =m—-1, R,=n-1; D=™m. 
This can happen in only two ways. The X’s should occupy either the first m places or the 


last m. Clearly, P(D =m) = P\Y, < X,)+P(X, < Y,) 
=n [ F(1—GydG+m | Gt1— FydF. (3-2) 


(ii) R,, = ™—1+%, R, =n-1+m, D=i(t =0,1, ...,n—1). 


Th 


By 


Th 


of 


4) 


5) 


6) 


re 


he 
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n—t—1 


Then P(D=1t)= JY P(Y, < X < Vgyy < ... < Vous < Xm < Vossys) 


s=1 
'm! 
= moBit@c |, +m - Sor — [aw 1 Gey} 
x [G(v) —G(u)]}' LF(v) — F(u) |" dF (u) dF(v). (3-3) 
(iii) R, =m—1+n, R, =n-1+j, D=n+m—j (j =0,1,...,.m—1). 
By symmetry, as in (ii) 
Ae 1+ F(u) — Fo)" — [1 — Foy — Ry} 
IN mA wel 
x [F(v) — F(w)/ [@(v) — @(u) J" 2 dG@(u) dG(v). (3-4) 
(iv) R,, = m—1+1, R, =n-14+j, D=m+i-j. 
This can happen either when the sequence starts with X, or Yj. 
P(D = m+i-)) 
= (X,,_; < Y,<(j-—1)X’s and (i—1) Y’s< X,, < Y;,;) 
+P(Y,_; < X,<(j-—1)X’s and (i—1) Y’s< Y,, < X;,;) 
m! n! 


~ (m—j)(j—1)! (n—t) G1)! 
where A, = . [F(u) "7 [F(v)- F(u) Pf (G(v) — G(u)}* [1 — Gv) }"—* dG (u) dF (v), 


P(D =m+n-}j) = 





[A, + Ag], (3-5) 


A,= J He LF (0) — Fu) (0) — Gu) [1 — Fo)" dG 0) AF (wu). 


Putting F = G in (i), (ii), (iii) and (iv), we obtain the distribution of D under the hypothesis 
as given by Kamat. 
To obtain the mean and the variance of D, we express the statistic D in the form 
D = (8m — 83) — (%_,—11) + 2, 


where s; is the rank of X; and r;, the rank of Y; in the combined sample of X’s and Y’s. 


Then 8 =t+ > $(Y;,, X;) 
k=1 

and r= 5+ BG(Xp¥), 
t=1 

where d(u,v)=1 if wer, 


= 0, otherwise. 
E(D) = E(8,,—8) — E(r, —17,) +n, 


var D = var (s,,—8,) + var (7, —1) — 2 cos (8, — 81, 7x —1)- 
Since ty—Ty = (n—1) +B HY, Xp), 
j=1 
E(r, —7) = (n—1)+mn(n—- nf [F(v) — F(u)] (G(v) — @(u)]"* d@(u) dG(v), 


var (r, —71,) = var > H(Y,, X;, Y,) = var W. 
j=1 
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Similarly, we have 


Blsq~8) = (m—1)+nm(m—1)[ (Go) —G(w)] Fw) — Fwy *dFu) dP), 


var (s,,—8,) = nm(m— vf [G(v) — G(u)] (Fv) — F(u)]"-? dF (u) dF (v) 


u<v 


[G(v) — G(u) P [F(v) — F(u) |"? dF (u) dF (v) 


u 


+m(m—1)n(n— »f 
2 


— n*m?(m — 1)? | [G(e) — G(u)] L[F(v) — F(u)}"* d F(v) aF(u)| 


cov (8m, — 81, ln r) ss Es,, Tn Es,,r, — Es,r, + Er,s, — E(8,,— 8) E(r,, a r). 


It can be shown that 
E(r,8,) = 1+ mn [FUL — Gy dG+ mn [ata —Fy"dF. 
E(r,8,,) = m+ mn [PU —Gy1dG+ mn [aR dF 
+nm(m—1){_ LP(oy #1 Guy) Fu) dau) do) 


+m(m—1)n(n— nf [ F(v)}" [1 — G(u)]"-? F(u) (G(v) — G(u)] dG(u) d F(v). 


E(s,r,) =n+mn | FQ"dG@ +n2m | G{1 — Fmd F 
+mn(n—1) | LE Fw 4 (o)]* Gu) dF (u) dv) 
+m(m — 1) n(n — nf ie [1 — F(u)}"* [G@(v)]"* G(u) [F(v) — F(u)] d F(u) dG(v). 
E(1y8m) = mn+mn i FQ"1d@ +n2m | GF"-dF 
+mn | LF — F"] GG + mn I (G-—@"] P™14F 
+m{m—1)m(n—1)] LF (u))™* Gu) (G(o)]"-* AF (uw) dG(0) 
+m(m—1) n(n —1) i __ Law Fw) LF (o)* dG(w) dF (2). 


Using these results, we obtain the mean and the variance of D under the alternative. 
Substituting F = G, we obtain 


E(s,, —8,) = = - vier $n ’ 
E(r,—1;) = (n —1)(m+n+1) . 


n+1 


2n(m — 1) (m+n+1) 
var (8,,— 8) = ~(m+1)2 (m+ 2) : 


2m(n—1)(m+n+1) 


bined (Ta-"1) = ~(n +1)? (n+ 2) — 


ve. 
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COV (7, — 145 8m — 81) = — =... 2 +2 tates 
n 1>°m a (m+1)(n+1) “eet | 
n 


Whence we obtain the mean and variance of D under the hypothesis as given by Kamat. 


4. PoWER OF THE TWO TESTS 


In this section we will consider the power of these two tests for small samples and for 
different levels of significance. For the sake of simplicity we will consider one sided alter- 
natives only. 


Let m = n = 5and a < 0-05. From the tables given by Rosenbaum and Kamat, the 5 % 
points of W and D are 5 and 10, respectively, so that 


P(W > 5) < 0-05, P(D> 10) < 0-05. 
Hence the power of the W test is given by 
By = P(W > 5| A) 


= 20 | [1+ F(u) — F(v)} [G(v) — G(u) B dG(u) dG(v). 


The power of the D test is given by 
Bp = P(D > 10| A) 


= 2of a + F(u) — F(v)) — LF (w)P — (1 — P(e) ?} [4(e) — @(u) P d@(w) d@(v). 


Clearly By > fp for all alternatives. 
The same procedure was carried out in a few more cases and it was found that in all these 


cases the power of the D test is smaller than the power of the W test. These cases are listed 
in Table 1. 


Table 1 
Sample size m = n 5 5 6 6 7 8 
Level of significance 0-025 0-05 0-01 0-05 0-01 0-01 


From the above results, we thus see that at least for small samples and low level of 
significance the D test is less powerful than the W test. As the calculations involved are 
particularly tedious, detailed investigations in regard to power were made for normal 
alternatives for the cases m = n = 5 and m = n = 6 only. Let F(x) = G(x0), 0 being a scale 
parameter and G(x) the normal distribution function. Using the methods of numerical 
integration, power was computed for different alternatives 0 = 0-9, 0-8, 0-4 and 0-1 for 
different levels of significance. These results are given in Tables 2 and 3. The exact size of the 
test is also given in each case. 


Table 2. m=n=5 





Exact Power of the test against the alternative 
size of cr ~ ‘ 
Test the test 6=0-9 6= 08 6 = 0-4 6=01 
a < 0-025 Ww 0-0238 0-0285 0-0331 0-1538 0-5526 
D “0159 -0206 0252 +1396 -5144 
a<0Ol1l1 Ww -1032 -1106 -1180 +4361 -8119 


D -0635 -0695 -0755 +3728 *9622 








360 BALKRISHNA V. SUKHATME 


Table 3. m=n=6 





Exact Power of the test against the alternative 
size of r “> 
Test the test 6= 0-9 6=0°8 6 = 0-4 6=01 
a< 0-01 Ww 0-0076 0-0095 0-0115 0-0873 0-4644 
D -0054 -0074 -0093 0827 -4478 
a < 0-05 Ww -0400 -0498 0595 +2945 -7605 
D 0271 “0362 0453 +2692 +8424 


It will be seen from Tables 2 and 3 that the power of the W test is in general larger than that 
of the D test, but that the exact size of the W test is always larger than that of the D test. 
This makes it difficult to compare the two tests. When the exact size of each test was 
calculated for different levels of significance and different sample sizes, the results given in 
Table 4 were obtained. It will be seen that the exact size of the W test is in general larger than 
that of the D test at least for low levels of significance. 


Table 4. Exact size of the W and D tests 


Sample a= 0-01 a = 0-025 a = 0-05 
s1ze eS ——oOoeoOoOoOoOoY i) 
m=n W D WwW D W D 
5 _ = 0-0238 0-0159 0-0238 0:0159 
6 0-0067 0-0054 -0076 0054 0400 0271 
7 0023 0020 -0146 0120 0146 0406 
8 0050 0038 -0203 0148 0203 0422 
9 0076 0058 -0249 0185 0249 0475 
10 0099 0076 -0099 0216 0286 0216 


Table 5. m=n=5 


Power of the test against the alternative 
. s 








Test 6=09 06= 0:8 6 = 0-4 d6=01 

a = 0-025 Ww 0-0297 0-0344 0-1581 0-5565 
D ‘0299 -0349 +1842 -6000 

F -0336 -0533 +3520 ‘9772 

a = 0-05 WwW *0556 -0611 +2470 +6382 
D -0556 -0613 +3068 +8354 

F -0686 -1040 +5000 -9896 

Table 6. m=n=6 
Power of the test against the alternative 

~ — ="? 
Test 6= 0-9 06= 08 0 = 0-4 6= 01 

a = 0-025 Ww 0-0311 0-0373 0-2468 0-6924 
D -0335 -0419 +2515 +8049 

F -0400 -0608 -4492 *9935 

a= 0-01 W *0125 -0151 +1027 -4865 
D 0135 -0169 +1223 +5315 

F ‘0154 0237 *2715 +9846 


~~ oo) 3 eo 
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To make a fairer comparison possible, the two tests were randomized so that each had 
the same level of significance. For example, in the case m = n = 5 for neighbouring integer 
critical values of W, the W test has exact levels « = 0-0238 and a = 0-1032. If we use the 
former point with chance 391/397 and the latter with chance 6/397, an effective significance 
level of « = 0-025 will result. These values of the power based on tests adjusted in this way 
are given in Tables 5 and 6. It will be observed that now the power of the D test is always 
greater than that of the W test, although the difference between the powers for the two 
tests is naturally very small for alternatives close to the hypothesis. 

We shall now compare these two non-parametric tests with the most powerful, variance- 
ratio F test. From the results given in Tables 5 and 6, it is clear that under conditions 
where the ¥ test is applicable the power of the two non-parametric tests is much less than 
that of the F test. Suppose that a test 7), of level of significance «, and using N, observations, 
has power f7, (Nj, x, 9) against alternative 0. If a test 7,, also of level «, requires N, observa- 
tions to produce the same power for the same alternative, the efficiency of T, with respect to 
T,, may be defined as the ratio N,/N,. Table 7 gives the efficiency for each of the two tests with 
respect to the variance ratio F test for normal alternatives. It will be seen that the D test is 
always more efficient than the W test. 





Table 7 
Efficiency of the test 
against the alternative 
Level of r A oan 
Sample size significance Test 6= 0-9 6 = 0-4 = 01 
m=n=5 a = 0-025 D 0-59 0-69 0-55 
W 57 -64 53 
a = 0-05 D 40 -69 60 
W 40 -60 50 
m=n= 6 a= 0-01 D 67 -67 52 
W 62 -61 49 
a = 0-025 D 58 68 “57 
Ww *52 68 -49 
SUMMARY 


Rosenbaum (1953) and Kamat (1956) have proposed non-parametric tests for testing the 
hypothesis that two samples come from the same population against the alternative that 
the Y’s are more spread out than the X’s and vice versa. This paper gives the exact 
distribution of the two test statistics under the alternative hypothesis and a discussion 
concerning the power of these two tests against scalar alternatives for small samples. 


I wish to thank Prof. E. S. Pearson for his useful comments. 
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Sampling inspection of continuous processes with no 
autocorrelation between successive results 


By W. D. EWAN anv K. W. KEMP 
British Nylon Spinners Ltd., Pontypool, Monmouthshire 


1. InTRODUCTION 


We consider here the problem of controlling the quality of the output of a continuous 
manufacturing process where quality will normally be maintained at an acceptable level 
for long periods of time, but where a change can take place which will result in the process 
manufacturing material to a quality level which is unacceptable. 

Our first attempts in this field were to take standard sequential and multiple sampling 
schemes derived for batch inspection problems and to use these schemes retrospectively, 
the first sample being the current sample the second sample being that taken immediately 
previous to the current sample and so on. An example of such a scheme is quoted by 
Barnard (1954). 

Page (1954) introduced the concept of cumulative sum charts based on Wald sequential 
schemes and since this original paper we have adopted this principle to give a wide range of 
inspection schemes with known properties. Barnard (1959) has recently drawn attention 
again to the cumulative sum chart and has prepared certain empirical methods for deciding 
when changes have occurred and for estimating the magnitude of these. 

We describe, in this paper, the methods which we have developed for our own use and 
which we have now been applying in practice since 1955. The method is entirely systematic, 
the parameters of a scheme with required properties can be determined easily, and in our 
experience the technique is very simple to apply either in graphical or tabular form. 


2. CUMULATIVE SUM CHART 


An advantage of the cumulative sum chart is that a change in quality can be seen much 
more easily by visual inspection than from the normal type of control chart where the results 
are plotted independently of each other. Fig. i shows a control chart where points on the 
first part of the chart have been sampled from a normal population with zero mean and unit 
standard deviation: half way along the figure the population mean has been changed to 0-20. 
Fig. 2 shows the cumulative sum chart of these results as in the presentation by Barnard 
(1959). It is much easier to detect the change from visual inspection of Fig. 2 than from 
Fig. 1. The magnitude of a change can be determined from the slope of the cumulative sum 
chart and both Page (1957) and Barnard (1959) have considered this question and that of 
determining the point at which a change occurs. 

If k is subtracted from each sample value and the resulting figure plotted the cumulative 
chart will slope downwards if the population mean m is less than k and upwards if it is greater 
than k. Schemes for which the cumulative chart slopes downwards for quality which is 
acceptable and upwards when quality is rejectable are similar to those described by Page 
(1954). We shall call & the reference value. Page suggests that the decision that quality has 
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changed should be made after the cumulative sum has changed direction and has exceeded 
the previous lowest result by a value of h or more. We shall call A the decision interval. 
Fig. 3 shows a comparison between the results of Fig. 1 and the same results plotted on 
a cumulative sum chart with lower boundary zero and upper boundary h using a reference 
value k = 0-10. Whenever a result greater than 0-10 is obtained the sum of the deviations 
from this value is accumulated until the sum returns below zero or exceeds the decision 
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Fig. 1. Standard control chart. Mean of first thirty results = 0-00. 
Mean of second thirty results = 0-20. 
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Fig. 2. Cumulative sum chart. Mean of first thirty results = 0-00. 
Mean of second thirty results = 0-20. 


interval. This type of chart is effectively very similar to that in Fig. 2 and a decision that 
quality has changed can be reached at the same time with both. A practical advantage of 
the method demonstrated in Fig. 3 is that the chart is bounded in the sense that the cumu- 
lative sum does not run off the paper. The principal involved is easily applicable to a table 
of successive results without recourse to plotting if no graph is desired. Fig. 2 provides 
a useful record of the past history of all the results that have been obtained, whilst the chart 
of Fig. 3 only records results which are likely to be relevant to the detection of a deterioration 
of quality. 
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Fig. 3. Control chart and cumulative sum plotted when required. 


3. AVERAGE RUN LENGTH AND AVERAGE DURATION OF AN INSPECTION SCHEME 


In order to present the properties of a continuous sampling inspection scheme we shall 
make use of the concept of the average run length (4.R.L.) described by Page (1954). The 
definition of the 4.R.L. used by us is the same as that given by Barnard and is slightly different 
from that used by Page. We define the average run length as follows: when the quality remains 
constant the average run length of an inspection scheme is the expected number of samples 
obtained before action is taken.* An important property of any continuous sampling scheme 
is the average amount of material produced at a given quality level before taking action. 
For a continuous manufacturing process producing at a constant rate this is directly related 
to the time which elapses before action is taken. We can define this quantity as the average 
duration of the inspection scheme. After a change in quality has occurred the average 
duration of a scheme using the cumulative sum chart will depend upon the position of the 
cumulative sum at the time when the first sample after the change is taken. If the process 
is sampled every s hours (say) and the sample is taken from current production an approxi- 
mate estimate of the average duration of a scheme can be obtained by using the simple 
expression (A.R.L.—1)s+¢. Here ¢ is the average time which elapses between the moment 
that the change occurred and the time that the first sample was taken. If the probability of 
the process changing to rejectable quality level (R.Q.L.) is constant with respect to time and 
is small relative to the sampling interval, ¢ is approximately }s and the average duration 
of the scheme at this quality is (A.R.L. — })s. 

Although the a.8.L. is used in this paper to characterize the sampling schemes discussed 
it is obvious that other parameters can be devised. For example, the frequency of obtaining 
run lengths greater than a given value at 8.Q.L. or less than another value at A.Q.L. could be 
more relevant in some situations. The distribution of run length is undoubtedly relevant 
to these and a method of obtaining it is described together with two examples. 


4, CALCULATION OF THE A.B.L. 


The scheme illustrated by Fig. 3 is equivalent to a succession of Wald sequential schemes 
with horizontal boundaries distance h apart. For convenience we take the lower line as 


* Page defines the a.R.L. as the expected number of items sampled before action is taken. 
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zero. P(z) denotes the probability that a test which starts at a point distance z from this 
line will end on or below it, while N(z) denotes the average sample number of the test. We 
use [(z) to denote the a.R.L. of a scheme in which the first cumulation starts at a point 
distance z from the lower boundary but in which subsequent cumulations start on this 
boundary. 

If the variate x which is being controlled is continuous P(z), N(z) and L(z) satisfy integral 
equations which have already been described by Page (1954). When z is a discrete variate 
which only takes integer values similar equations to these can be formulated when z, h the 
decision interval, and k the reference value also take integer values. If f(x) represents the 
probability of obtaining the value x and 


F(a) = Sfte) 


then P(z) = F(k—z)+' & Ply)fly+k—2), (1) 
y=1 
=h— 
N(@)= 14" S Ny fly+k—2), (2) 
on 
L(z)=1 +1(0)F(k—2)+" & Lelfiy+k—2). (3) 
p 


The method described by Kemp (1958) to obtain approximate solutions of the equations 
for P(z) and N(z) when z is normally distributed can easily be generalized for use with both 
continuous and discrete functions. Let m be the mean of x; further: 

(i) For a continuous variate, if f(x) dx is the probability density of x, let 


F(a) = ie fle)de, M(a) = | : 


af(x) dz, 


and G(a) = L ev= f(x) dx, 


where w is a real non-zero root of the equation, 


+a 
| eX f(x) dx = ev*, 


2) 


(ii) For a discrete variate, let 


F(a) = E fle), Ma) = Safle) 
and Ga) = Lesa), 
where w is a real non-zero root of the equation 
Sef(e) ax ev, 


By the method mentioned we obtain for a continuous variate or a scheme with a discrete 
variate with integer values of h and k 
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where K, = 1+{[F(h+k)*—F(k)]e™—e-“ (G(h+ k)* —G(k)}}/(l—e), 
Ky = {e-™ [G(h + k)* — G(k)] —[F(h + k)* — F(k)}}/(l1—e""), 
Ky = {F(k)* — F(k—h) —e-”* [G(k)* — G(k—h)}} et /(1—e""), 
Ky = 1—{F(k)*— F(k—h) —e-"®-[G(k)*— G(k—h)}/(1—e"), pee 
By = 1-{K,h+ M(h+k)* —M(k)—k[F(h+k)* —F(k)}}/(m—k), 
B, = 1—{(1—K,)h + M(k)* — M(k—h) —(k—h) [F(k)* — F(k—h)}}/(m—k). 


In these equations F(t)* = F(t) for a continuous variate and F(t — 1) for a discrete variate ; 
G(t)* and M(t)* are similarly defined. 
P(z) = {[P(h) — P(0) e"] + [P(0) — P(h)]e™}/(1—e"), (6) 
N(z) = {N(h) —-N(0) eh" + h/(m—k) + [N(0) — N(h) —h/(m—k)] e* —2}/(m—k) (1—e™). (7) 
Approximate values of P(z) and N(z) for z = 1, 2, ..., (2—1) can be calculated with equa- 
tions (6) and (7) and these values can then be used to obtain better values of P(0) and N(0). 
A method of successive substitution can be employed which quickly leads to the true values 
of P(0) and N(0). To obtain P(0), for exampie, when ~ is a discrete variate we take the linear 
set of equations for P(z) (z = 0,1, 2,...,4) generated by equation (1) and substitute the 
approximate values for P(0), P(1), ..., P(—1) into the equation for P(h) and recalculate 
P(h). This value, together with the original values of P(0), P(1), ..., P(h—2), is then sub- 
stituted in the equation for P(i—1) and a new value for this is calculated and so on. The 
procedure is repeated until the true value of P(0) is obtained. N(0) can be found in a similar 
way. If x is a continuous variate the linear equations are formulated from the integral 
equations satisfied by P(z) and N(z) using methods of quadrature. 
When P(0) and N(0) are known, L(0) can be obtained since 


L(0) = N(0)/{1— P(0)). (8) 


A method which can be used for the discrete case to determine P(0) and N(0) exactly 
when the variate only assumes integer values has been described by Girshick (1946). It 
has been applied to the case where articles are classified as defective or non-defective and 
where unit samples are taken. Often in industrial practice it is neither desirable nor 
practical to take such samples. The method described here can be used to obtain approxi- 
mate A.R.L.’s of schemes for any sample size and the exact values can be obtained if 
required with less computational effort than is required by the method of Girshick. 

Equations (1), (2) and (3) only apply to situations where h, k and z take integer values; 
if these parameters can have fractional values then they must be modified. It will be 
convenient to postpone discussion of this particular case until we consider schemes for a 
Poisson variate. 





5. THE RUN-LENGTH DISTRIBUTION 


If p(n, z) is the probability that a test starting at z will have a run length n then if z is 
a continuous variate 


h 
p(n, 2) = p(n—1,0) F(k=2)+ { “p(n Lyf(y+k—2)dy. (9) 


It follows that from this equation, if ¢(z,t) is the moment generating function of the 


run-length distribution, then - 
P(2,t) = p(n, 2) em 








368 - W. D. Ewan anv K. W. Kemp 
satisfies the equation 
h 
e+ d(z,t) = 1—-F(h+k—z) +¢(0,t) Pe—2)+ | Ply, t) fly +k—z) dy. (10) 


If we differentiate equation (10) and put ¢ = 0 in the usual way we can obtain integral 
equations which the moments of n satisfy. For example, after differentiating once we obtain 
the equation for L(z) given by Page (1954), viz. 


h 
L(z) = 1+1(0) F(k—2)+ [ L(y) f(y +k—z) dy, (11) 
whilst if ~3(z) denotes the second zero moment of n we find 


h 
wile) = 2L(2)— 1+ pi(0) F(k—2) + I “HONS (y + k—2) dy. (12) 


The moment generating function of n can also be expressed as a function of the moment 
generating functions of the number of samples in a single acceptance test and a single 
rejection test. If for tests starting on the acceptance boundary these are ¢,(¢) and ¢,(t), 


respectively, then (0, t) = [1-P(0) da(¢)]/[1 — P(0) 4, (6)]. (13) 


Equation (13) shows that the run-length distributions of schemes with a high average run 
length also have variances which are greater than the square of the a.R.L. For if V(N) is 
the variance of the sample number of a single test and V(n) is the variance of the run-length 
distribution, then from equation (13) we find that at acceptable quality level 


V(n) = L°(0) + V(N)/[1 — P(0)}. (14) 


Equation (14) shows that when L(0) is large, which will generally be the case when quality 
is being manufactured at an acceptable level, a(n) = L(0). It is therefore reasonable to 
anticipate that, except for very small values of n, a close approximation to p(n, 0) will be 
given by the expression 1 coe 
p(n, 0) = Lo)? Loy’ (15) 


so that the probability of obtaining a run length aL(0) is 


. ae 0) = 1—exp Eom (16) 
1 esti L(0) 


When the probabilities of a single test ending on the upper or the lower boundary at 
a given stage are known it is possible to obtain the run-length distribution with use of a 
simple recurrence relationship. If p,(m) and p,(m) are respectively the probability that a 
single test will end at the mth sample on the upper or lower boundary, it can easily be shown 
that m=n—1 


p(n, 0) = py(n) + x pm) p(n —m, 0). (17) 
If g,,(Y¥) represents the conditional frequency distribution of 


Yn = = ve, 
i=1 


h 
for a single test then Im(Ym) = [is (Ym —Y) Im—r(y) Ly. (18) 
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P,(m) = { In(y) dy; pm) = i 


my) dy. (19) 


Equations (18) and (19) are extremely useful when p,,(m) and p,(m) have to be obtained 
by quadrature. 
6. NORMAL VARIATE 


If x is normally distributed with mean m and unit standard deviation then 
w=-—2(m—k), K,=K, and e”K,= Kj. 


If $(y) = 2m)-texp—ty* and o() =|" gu)dy, 
we obtain F(a) = O(a—m), M(a) = m®(a—m)—(a—m) d(a—m), 
e-vk G(a) = O(a +m — 2k). 
Approximate values for P(0) and N(0) can be calculated from the expressions which are 
obtained when these results are substituted in equations (4) and (5). More accurate values 


of P(0) and N(0) and hence L(0) can then be obtained by successive substitution as already 
described. 


A useful approximation to Z(0) when m—k and h have the same sign is 
L(0) = 1+h/(m—k). (20) 
This simple expression will give a reasonable approximation to the value of L(0) provided 
m — kis not nearly zero and provided h is sufficiently large. In fact the approximation seems 
to be satisfactory for values of i > 2. In the practical field where schemes are devised to 
control the quality level of continuously operating industrial processes inaccuracies incurred 
by the use of equation (20) over the range described will cause little concern. 


7. NOMOGRAMS FOR THE A.R.L. 
Table 1. Values of L(0) for different h and m—k for a normal variate with unit variance 


(a) Negative values of m—k 


h=2 h=3 h=4 h=5 
:- ts a —— ica rac. 
m—k L(0) m—k L(0) m—k L(0) m—k L(0) 
— 1-30 951 — 0-90 1056 — 0-65 954 — 0-50 983 
— 1-25 761 — 0°85 785 — 0-60 668 — 0-45 636 
—1-15 491 — 0-80 587 — 0-55 481 — 0-40 456 
— 1-00 258 — 0:70 327 — 0-50 341 — 0:35 310 
— 0-80 115 — 0-60 201 — 0-40 181 — 0-30 214 
— 0-60 54 — 0-50 100 — 0:30 103 — 0-20 110 
(b) Positive values of m—k 
h=2 h=3 h=4 h=5 

m—k L(0) m—k L(0) m—k L(0) m—k L(0) 

1-25 2-35 1-80 2-57 2-50 2-55 3-50 2-37 

1-20 2-50 1-20 3-40 1-50 3-64 3-00 2-48 

1-00 2-74 1-00 3-90 1-00 4-90 2-50 2-99 

0-80 3-36 0-90 4-17 0-80 5-80 1-50 4-31 

0-60 4-15 0-80 4-50 0-60 7°34 1-00 5-90 

0-30 5-84 0-60 5-63 0-50 8-70 0-75 7-44 

0-20 8-41 0-40 7-40 0-40 10-20 0-50 10-42 

0-15 7-54 0-20 10-18 0-30 12-60 0-40 12-13 
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Fig. 4. Nomogram showing the relationship for a normal variate between (4 ,/n)/o, (h./n)/o and 
average run length at A.Q.L. 0 = (reference value —A.Q.L.), h = decision interval, n = sample 
size. 


Values of the 4.R.L. of a number of schemes for a normal variate with unit variance were 
obtained by the method just described. The values obtained for L(0) after successive sub- 
stitution in the appropriate equations are shown in Tables la and b. From the data given in 
these tables and the techniques described by Lyle (1954) itis possible to construct nomograms 
from which the 4.R.L.’s of a wide variety of schemes can be obtained at both acceptable 
and rejectable quality levels (R.q.L.). A nomogram which has been constructed in this 
way is shown in Fig. 4. From this diagram the a.R.u.’s of a number of schemes at A.Q.L. 
can be obtained. A similar one can be drawn for R.g.L. In Figs. 4 and 5, o is the standard 
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Fig. 5. Nomogramshowing the relationship for a normal variate between (0 ./n)/o, (h./n)/o and 
averagerun length aiR.Q.L. # = (R.Q.L. — reference value), = decision interval,n = samplesize. 


deviation of the population which is being sampled and whose mean value is being con- 
trolled, ” is the size of the sample which is taken at each test and 0 = |m—k|. If m, is the 
mean at A.Q.L. the A.R.L. at A.Q.L. is obtained by placing a ruler on the nomogram so that it 
joins the points h ,/(n)/o and @,/(n)/o = (m,—k),/(n)/o, and reading off the run length from 
the scale on the right-hand side of the diagram. The a.R.L. at R.Q.L. when the mean is m, 
is obtained in the same way from Fig. 5.* 

A number of schemes can be constructed using different decision intervals and reference 
values which will have the same A.R.L., either at A.Q.L. or B.Q.L. or at both. It is possible to 


* The accuracy obtained from using the nomograms is demonstrated in the Appendix. 
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show, with use of the nomograms, that there are advantages to be gained by using a central 
reference value, i.e. k = }(m,+m,). We find for example, that for a fixed sample size, of 
the schemes which have the same A.R.L. at A.Q.L., the A.R.L. at R.Q.L. is minimized when k 
is in the region of 4(m,+m,). If a scheme is required which should have given values for 
the a.R.L. at both 4.Q.L. and R.Q.L. we find that the level of sampling required is at a minimum 
when k = 3(m,+m,). If, however, a graph of sample size plotted against reference value is 
drawn, it will be found that this curve shows a ‘shallow’ minimum in the region of the 
central value. Provided therefore that the reference value is in the region of the central 
value there will be negligible difference in sample size. This has practical value in the actual 
use of a scheme on the factory floor, where it is an advantage to use a reference value which 
has been rounded off, to simplify the arithmetic necessary to operate a scheme. The run 
lengths of a few schemes with various combinations of decision interval and 0 = 3|m,—™m,| 
are shown in Table 2. These values were obtained with use of the nomograms just described. 


Table 2. Values of reference value and decision interval for 
different choices of A.R.L. for a normal variate 


On hn 

A.R.L. at A.Q.L. A.R.L. at R.Q.L. — — 
o o 

1000 3 1-12 2-40 

1000 7 0-65 4-06 

500 3 1-04 2-26 

500 7 0-60 3-80 

250 3 0-94 2-11 

250 7 0-54 3°51 


8. EXAMPLE OF A SCHEME FOR A NORMAL VARIATE 


Suppose we wish to maintain the mean value of a measured property of a certain manu- 
factured article at 5 units or more and that when the process is manufacturing items at 
this level it should not be interfered with in error on the average more than once in 500 hr. 
If, however, the mean drops below 4-80 units then on average we wish to detect the change 
in 64hr. Let us also suppose that it is only convenient to test once per hour and that the 
standard deviation of the process is constant and equal to 0-48 units. 

To determine the number of articles we need to test hourly and to find the decision 
interval we may use Table 2. We find that for a.R.L.’s of 500 and 7, respectively, at A.Q.L. 
and R.Q.L., (9,/n)/o = 0-60, where 0 = }(4.Q.L—R.Q.L.) = 0-10; thus n = 8-30. We would 
therefore take samples of 9; this gives a scheme in which (0,/n)/o = 0-625. By using the 
nomograms we find that if the a.R.L. at A.Q.L. is to be 500 then (h./n)/o = 8-67, which gives 
h = 0-59 and an A.R.L. at R.Q.L. of 6°8. 


9. SAMPLE SIZE AND SAMPLING INTERVAL 


From the nomograms of Figs. 4 and 5 it is possible to determine the most suitable values 
of the reference value and the decision interval to use once the A.Q.L. and R.Q.L. have been 
defined and the average durations at these qualities have been specified. We find from these 
nomograms that the relationship between the sampling interval and sample size is very 
nearly linear so that the difference in average duration at 4.Q.L. and R.Q.L between taking 
one sample every hour, or a sample, three times as big, every third hour is relatively small. 
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It is therefore best to sample as frequently as practical considerations allow, and to 
determine the appropriate sample size accordingly. 


10. THE RUN-LENGTH DISTRIBUTION OF A SCHEME FOR A NORMAL VARIATE 


The run-length distributions at 4.Q.L. and B.q.L. of a scheme for controlling the mean of 
a normal population were calculated by using equations (17), (18) and (19). The population 
being sampled had unit variance; at a.Q.L., m,—k was taken to be —0-50, and at R.Q.L. 
m,—k = 1-00; the decision interval used was h = 3. The shapes of the two distributions 
obtained are given in Figs. 6 and 7. 
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Fig. 6. Run-length distribution for a scheme with h = 3 and samples drawn from a normal 
population with mean = 1-00 and unit variance. Reference value = 0. Average run length 
= 3-75. 


At rejectable quality the distribution has the desirable properties that the probability of 
obtaining a run length less than the average is high and that the chance of getting a run 
length greater than three times the average is small. In this particular example the a.R.L. 
at R.Q.L. is 3-75 and the probability of obtaining a run length of 4 or less is 0-7377. The chance 
of getting a run length greater than three times the A.R.L. is approximately 1 in 650. 

Fig. 7 shows the correspondence between the run-length distribution at 4.Q.L. and the 
negative exponential distribution of equation (15). It is important to recognize that at 
A.Q.L. the probability of obtaining runs less than the average is high. In our example the 
chance of getting a run less than 20, i.e. about one-fifth of the average is 1 in 7. The actual 
value of this probability is 0-1406, whilst the value given by equation (16) is 0-1496. When 
L(0) is large, the probability of obtaining a run length less than a given multiple of the 
average value is nearly invariant, since 


a L(0) 
>d p(n, 0) = l-—e*. (21) 
1 
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For high values of L(0) therefore the run-length distribution is specified completely by 
L(G). It follows that any alternative method of specifying the characteristics of a scheme 
at A.Q.L. can be expressed in terms of L(0). For example, in some circumstances it may be 
desirable to ensure that the probability of obtaining a run length at 4.q.L. less than a given 
figure does not exceed a specified value. The values of L(0) appropriate to this condition can 
be obtained from equation (16). To take a specific case at A.Q.L., we may wish the probability 
of obtaining a run length < 50 not to exceed 0-10. This is equivalent to choosing a scheme for 
which at 4.q.L. L(0) = 467. As a further example, we may take the situation where the cost 
of erroneously concluding that the process is out of control is directly related to the time 
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Fig. 7. Run-length distribution for a scheme with h = 3 and samples drawn from a normal 
distribution with mean = — 0-50 and unit variance. Reference value = 0. O = points on nega- 


1 -1 
tive exponential distribution p(n, 0) = Lo) exp [ — Ta | . Average run length = 116-8. 


which elapsed since the process was last set in motion. If the cost function c(n) relates the 
cost of unnecessary process investigation to running time and if the condition is laid down 
that the average cost due to this type of investigation must not exceed C, then the value of 
(0) which will ensure that this is so will be given by the equation 


o= Sry - Toy | ~ 


11. CONTROL OF THE STANDARD DEVIATION FOR A NORMAL VARIATE 


To control the standard deviation of a process following a normal distribution with use 
of the range, we can use equations (4) and (5) to calculate the a.R.L.’s of a particular scheme 
when a function which approximates to the distribution of the sample range is used. For 
example, we may assume (Cox, 1949) that if x is the sample range or the mean of a number 
of ranges, f(z) has the form (a/a)>— e-z!a 

fe) a 


in which case w is the non-zero real root of the equation 


e“* (1—au)’ = 1. (23) 
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If we use the notation employed in Tables of the Incomplete Gamma Function (1957) we 


have 
F(a) = I[a/(«/b),b—1], M(a) = abl[a/{a./(b+ 1)}, 6-1), 


e-wk Ga) = I ter oul b- i). 
a/b 

These expressions can be used to calculate approximate values of the a.R.L.’s for schemes 
designed to control the process standard deviation with the use of the range when the 
number of results available is small and when the above distribution is an adequate approxi- 
mation to the distribution of the sample range. Davies & Pearson (1934) have given a table 
of the values of the first two Pearson coefficients of the distribution of the mean of n ranges 
or r observations. From these calculations we conclude that for the purpose of estimating 
approximate values of the A.R.L. at A.Q.L. it is reasonable to assume that the mean range is 
normally distributed when 3 < r < 10 and when n > 3. For these values of r and m the 
nomogram of Fig. 4 can be used to determine schemes for the control of the process standard 
deviation as well as the process mean. In the figure, therefore, n is the number of ranges used 
to calculate the mean range and @ is the standard deviation of the distribution of individual 
ranges which can be obtained, for example, from Table 20 given by Pearson & Hartley (1954). 


12. SIMULTANEOUS CONTROL OF THE PROCESS MEAN AND STANDARD DEVIATION 


We have examined the problem of controlling separately the mean or standard deviation 
of a normal variate. We now consider the case when both these parameters may vary at the 
same time, but where we are only concerned with controlling the percentage of items 
outside a specified limit a. If y is a suitable function of the estimated mean and standard 
deviation we may do this by the method already described by subtracting a reference value 
k from sample values of y, formulating the cumulative sum and using a decision interval h. 
A convenient form of y is y = (a—)/s, where % is the sample mean and s is an estimate of 
the process standard deviation made from the sample. We can write 


=) MI): 


where y is the process mean and o its standard deviation. At acceptable quality level 
a— = ao and at rejectable quality level a—y = fo. If s the estimate of o is obtained by 
summing squared deviations about the sample mean, or from the mean of a number of ranges 
assumed to be distributed as y/,/v based on v degrees of freedom, y will be distributed as the 
non-central t. We have not yet been able to apply equations (4) and (5) to obtain approximate 
values of the A.R.L.’s of different schemes since we have not been able to solve the equation 





+0 
| env f(y) dy = ew 


in a convenient form. We have found for a number of different distributions that if at R.Q.L. 
the mean value of the parameter being controlled is m,, the approximation 
L(0) = 1+h/(m,—k) 


for all practical purposes gives a satisfactory estimate of the true value of L(0) over a wide 
range of values of h and m,—k. The reason for this is fairly obvious. It seems reasonable to 





376 W. D. Ewan anv K. W. Kemp 


anticipate therefore that in the present instance a close approximation to the A.R.L. at 
R.Q.L. will be given by the expression 1 + 4/0, where 


6 = [By Tw—-Hi2TQI-k (24) 


in which k is the reference value and p is the effective number of degrees of freedom on which 
the estimate of the process standard deviation is based. An approximate estimate of the 
magnitude of the 4.R.L. at A.Q.L. can be obtained by finding the a.R.L. of the scheme for 
a normal variate with equivalent mean and variance. This procedure will often over- 
estimate the actual a.R.L. of the scheme at A.Q.L. since the area in the relevant part of the 


tail of the normal distribution will usually be less than the corresponding part of the non- 
central t. 


13. POISSON VARIATE 
If z is a Poisson variate with mean m, then we can obtain the a.R.L.’s of ascheme by using 
equations (1) to (5) in which 
F(a) = Sm? e-™/x!, M(a) = mF(a—1), 
0 ny 


(me 
a! 


eta) = 5" 
0 





exp ( — e”), 
where w is the real non-zero root of the equation 
m(e“—1) = uk. (25) 


It is convenient at this stage to modify the notation used for P(z), N(z) and L(z). Accord- 
ingly P(z,k, h) will be used to denote P(z) for a scheme with reference value k and decision 
interval h. N(z,k,h) and L(z,k,h) similarly define N(z) and L(z) for the same scheme. 

If calculations are undertaken to determine the A.R.L. of a number of schemes with 
different values of h and k but the same value of m, considerable economies in computing 
effort can be effected with use of the approximate relationships 


P(z,k,h) = P(z—1,k—1,h+1), (26) 
P(z,k,h) = P(z+1,k,h+1). (27) 
For example, ifm = 3,z = 1,k = 5 and h = 5 we have 
P(1, 5,5) = 0-9925, P(0,4,6) = 0-9892, P(2,5,6) = 0-9918. 


If P(z,k,h) is known for all z between 0 and h, accurate values of P(z+1,4,h+1) can 
quickly be obtained by direct substitution in the set of equations generated by equation (1) 
and using equation (27). 

Calculations of the true A.R.L. at A.Q.L. and R.Q.L. of a number of schemes for a Poisson 
variate were calculated in this way. From these a number of schemes with a.R.L. at A.Q.L. 
of 500 and a.R.L.’s of 3 and 7 at R.Q.L. were determined by graphical interpolation. We have 
found these particular values of the a.R.L. to be useful in practice. The values of h, k and m 
which relate to these schemes are given in Tables 3 and 4. We find from these tables and other 
calculations that the schemes for which the sample size is smallest are those which have 
reference values which are in the neighbourhood of the central value. Accordingly, only 
the schemes with reference values in this region are shown in the tables. It should be 
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Table 3. Values of m,, m,, R = (m,/m,), h and k for schemes with a.R.L. = 500 
at A.Q.L. and A.R.L. = 7 at B.Q.L. for a Poisson variate 


R h k Me m, R h k Me Mm, 
4-64 2 1 0-22 1-02 1-65 9 5 3-84 6°33 
3-41 3 1 0-39 1-33 1-64 10 5 3:98 6-52 
3-04 4 1 0-52 1-58 1-60 8 6 4:40 7-02 
2-90 5 1 0-62 1-80 1-59 9 6 4-60 7-30 
2-80 6 1 0-70 1-96 1-58 10 6 4-75 7-50 
2-79 7 1 0-77 2-15 1-57 11 6 4-89 7-70 
2-43 + 2 1-01 2-45 1-55 9 7 5-33 8-26 
2-29 5 2 1-18 2-70 1-54 10 7 5-51 8-46 
2-21 6 2 1-31 2-89 1-53 11 7 5-67 8-65 
2-15 7 2 1-43 3:07 1-52 9 8 6-07 9-24 
2-12 8 2 1-53 3-24 1-50 10 8 6-28 9-45 
2-10 9 2 1-62 3-41 1-50 ll 8 6-45 9-65 
2-07 5 3 1-75 3-62 1-49 12 8 6-58 9-83 
1-97 6 3 1-95 3-84 1-48 10 9 7:05 10-44 
1-89 7 3 2-13 4-03 1-47 11 9 7:25 10-65 
1-87 8 3 2-26 4-22 1-47 12 9 7:38 10-83 
1-85 9 3 2-37 4-40 1-46 10 10 7-81 11-40 
1-79 7 + 2-79 5-00 1-44 ll 10 8-05 11-61 
1-76 8 4 2-96 5-20 1-44 12 10 8-20 11-81 
1-74 9 4 3-10 5-39 1-42 11 1] 8°85 12-61 
1-72 10 + 3°21 5-52 1-42 12 11 9-00 12-81 
1-67 8 5 3-68 6-16 

Table 4. Values of m,,m,, R = (m,/m,), h and k for schemes with a.R.L. = 500 
at A.Q.L. and A.R.L. = 3 at B.Q.L. for a Poisson variate 

R h k Ma m, R h k Ma mM, 
7:77 2 1 0-22 1-71 2-26 5 6 3-57 8-06 
5-64 3 1 0-39 2-20 2-18 6 6 3-90 8-50 
5-19 4 1 0-52 2-70 2-14 7 6 4:17 8-91 
4-98 5 1 0-62 3-09 2-12 8 6 4-40 9-31 
4-05 3 2 0-79 3-20 2-07 6 7 4-60 9-50 
3-63 4 2 1-01 3-67 2-04 7 " 4:87 9-92 
3-43 5 2 1-18 4-05 2-02 8 7 5-11 10-33 
3-34 3 3 1-23 4-11 2-00 6 8 5:24 10-50 
2-97 4 3 1-52 4-51 1-96 7 8 5-57 10-91 
2-87 5 3 1-75 5:03 1-95 8 8 5-83 11-38 
2-83 6 3 1-95 5-51 1-94 9 8 6-07 11-80 
2-77 7 3 2-13 5-91 1-91 7 9 6:25 11-92 
2-75 4 4 2-04 5-60 1-89 8 9 6-55 12-39 
2-58 5 + 2-33 6-02 1-87 9 9 6-83 12-79 
2-52 6 4 2-58 6-50 1-86 7 10 6-94 12-93 
2-48 7 4 2-79 6-91 1-84 8 10 7:28 13-39 
2-47 8 + 2-96 7-31 1-82 9 10 7:57 13-80 
2-43 5 5 2-92 7-09 1-80 8 1] 8-00 14-40 
2-35 6 5 3-21 7-53 1-78 9 11 8-30 14-80 
2-30 7 5 3-46 7-96 1:77 10 11 8-59 15-23 
2-27 8 5 3-68 8-34 


noted that it is not possible to interpolate in these tables for non-integral values of 
h and k. 

Situations arise in which the value of the mean is small and the number of items which it 
is possible to test is also small, so that the values which m, and m, take are such that schemes 
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with fractional values of h and k have to be used. If L(0,k, h) is the a.R.L. of a scheme in 
which hf and k are integers and if Ah represents a small non-integral increment in h, then 


L(0,k,h+Ah) = L(0,k,h+1). 


A discontinuity occurs in L(0,k, h) at h. 
For schemes where it is necessary to use fractional values of h, the equations satisfied by 

P(z,k,h) and N(z,k,h) must be written in forms which take into account the discontinuous 

nature of the distribution function. For example, we write 

k—2z) m” e-m {k+h—2z} m” e-m 


if 
Pk h) = Ey ¥ P(w+z—h,k,h) 


> 
[k—z]+1 w! 








(28) 


where [x] denotes the nearest integer which is < x and {x} denotes the nearest integer y 
which is such that y < x. A similar equation holds for N(z,k,h). P(z,k,h), N(z,k,h) and 
L(z, k, h) are discontinuous functions of z, k and h. We have already remarked upon the dis- 
continuity in L(0,k,h) when h is increased by a small amount from an integral value. It is 
not difficult to show that discontinuities in L(0,k,h) also occur at integral values of k. 
It can be shown that when A is an integer 


P(0,k+Ak,h) = P(0O,k,h+1), P(0,k—Ak,h) = P(O,k, h). 


Examples of the order of the changes in A.R.L. which occur due to these considerations 
are shown in Table 5 for the case where m = 0:10 and h = 2. 


Table 5. Values of L(0,k,h) for different k when m = 0-10 and h = 2 


k L(0,k, h) k L(0, k, h) 
0-20 146 0-31 365 
0-30 350 0-32 366 
0-40 697 0-33 366 
0-45 886 0-34 654 
0:50 888 0-35 654 
0-55 2958 0-36 657 
0-60 3022 0:37 666 
0-70 5082 0-38 694 
1-00 5646 0-40 697 


Values of the mean for a Poisson variate, which give an A.R.L. of 500 at 4.Q.L. and 7 at 
R.Q.L. have been obtained for a number of schemes which use fractional values of the 
reference value k and the decision interval h. These have been calculated for situations in 
which the sample size for some reason or cther must be small. The values of m, and m, have 
been obtained as above by graphical interpolation after run lengths of various values of m 
had been computed. Values of the a.R.L. at A.Q.L. were obtained by the tedious method of 
enumerating all the possible paths which cross either decision boundary. The 4.R.L. at 
R.Q.L. was obtained by substituting the approximation 


L(z,h,k) = 14 (h—2z)/(m,—k) (29) 


into the equation for L(0,h, k). The appropriate values of h, k used on the right-hand side 
of the equation are determined with due regard to the discontinuous nature of L(z, h, k). 
In other words the values of A and k used to determine L(z,h,k) would not in general 
be the same on both sides of the equation. To take a simple example which makes this more 
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explicit, if we wished to estimate L(z, k, 3-10) when z and k are integers, the value of h which 
we would take for 1+ (h—z)/(m—k) would be 4 and not 3-10. 
The results obtained from these calculations are given in Table 6. 


Table 6. Values of m,,m,, R = (m,/m,), h and k for schemes with non-integral values 
of h and k which have a.R.L. at A.Q.L. = 500 and A.R.L. at B.Q.L. = 7 


R h k Ma Mm, R h k Me M, 
5-11 4-00 0-30 0-19 0-97 3-70 3°75 0-60 0-33 1-22 
5-07 3-00 0-30 0-15 0-76 3-59 3-00 0-70 6-32 1-15 
5-06 3°25 0-30 0-16 0-81 3-54 3°50 0-70 0-35 1-24 
5-06 3-50 0-30 0-17 0-86 3-54 3-00 0-80 0-35 1-24 
5-00 3-75 0-30 0-18 0-90 3-53 3°25 0-70 0-34 1-20 
4-78 3-00 0-40 0-18 0-86 3-50 4-00 0-60 0-34 1-22 
4-57 3-00 0-50 0-21 0-96 3-47 3-25 0-80 0-38 1-32 
4-40 3-50 0-40 0-22 0-97 3-42 3-75 0-70 0-38 1-30 
4-38 3-25 0-40 0-21 0-92 3-41 3-00 0-90 0-39 1-33 
4-38 4-00 0-40 0-24 1-05 3°33 4-00 0-70 0-40 1-33 
4-34 3°75 0-40 0-23 1-00 3-33 3°25 0-90 0-42 1-40 
4-20 3°25 0-50 0-25 1-05 3-31 3-50 0-80 0-41 1-36 
4-20 3-50 0-50 0-25 1-05 3-23 3°75 0-80 0-43 1-39 
4-11 3-75 0-50 0-28 1-15 3-2 3°75 0-90 0-49 1-49 
4-11 4-00 0-50 0-28 1-15 3-20 4-00 0-80 0-45 1-44 
3°81 3-00 0-60 0-27 1-03 3-10 3-50 0-90 0-46 1-43 
3-74 3-50 0-60 0-31 1-16 3-00 4-00 0-90 0-51 1-53 
3-73 3-25 0-60 0-30 1-12 


14. EXAMPLE OF A SCHEME FOR A POISSON VARIATE 


Suppose we wish to control the level of faults which can be seen in lengths of fabric 
and that quality is acceptable if the faults do not exceed a mean of 5 per 10® yards and 
rejectable if the mean number of faults per 10° yards exceeds 10. We suppose also that we 
require the A.R.L. at A.Q.L to be 500 and the a.R.L. at R.Q.L to be 7. We can find the decision 
interval, the reference value and the number of yards of fabric we need to examine at a time 
by using Table 3. We find the values of k and h which give us a ratio R = (R.Q.L./A.Q.L.). 
If, in the table, we find more than one scheme with this value of R, we choose that one for 
which m, is a minimum. For this example, the nearest value of R is 1-97 with h = 6 and 
k = 3, m, = 1:95 and m, = 3-84. For this scheme the number of yards of fabric we need to 
examine is (1-95/5) x 10° yards = 0-39 x 10° yards. 


15. FRACTION DEFECTIVE INSPECTION SCHEMES 


Tables 3, 4 and 6 can also be used to formulate schemes for the control of the proportion 
of defective items being produced, provided this proportion is very small so that the Poisson 
distribution may be used to describe the sampling distribution of the number of defective 
items which will occur in an r-fold sample. 


16. EXAMPLE OF A SCHEME FOR CONTROLLING THE PROPERTIES 
OF DEFECTIVE ITEMS BEING PRODUCED 
We may take the example where p,, the proportion of defective items which can be 
tolerated at A.Q.L. is 0-0050, where p, the proportion of defective items at R.Q.L. is 0-0150, 
where the A.R.L. at A.Q.L. is to be 500 and that at R.Q.L. to be 7, and where rp, = m, and 
24 Biom. 47 
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rp, = ™,, so that m,/m, = p,/p, = 3:00. The nearest value of R we obtain to this from 
Table 3 is R = 3-04 when k = 1 and h = 4, m, = 0-52 so that r = 104. We would therefore 
take samples of 104 at regular intervals, count the number of defectives, form the cumulative 
sum about a reference value of 1 and take action if this becomes > 4. 


The authors wish to thank the Directors of British Nylon Spinners Limited for permission 
to publish this paper. They are also grateful to Professor G. A. Barnard for useful dis- 
cussions and to Dr E. 8S. Page for suggesting several improvements to the original draft. 
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APPENDIX (added in proof) 


Barraclough & Page (1959) have published exact computations of the values of the various para- 
meters for a number of Wald sequential tests. From these it is possible in a few instances to compare 
values of L(0) obtained from the nomograms shown in Figs. 4 and 5 with exact values obtained with 
use of the tables given at the end of their paper. The table below shows the comparisons it was possible 
to make, the columns headed B. & P. show the vales of L(0) obtained from the work of these authors 
whilst the values obtained from the nomograms are shown in the columns headed ‘Nom.’. 


Comparison between values of L(0) obtained from Barraclough & Page’s calculations 
and those obtained from the nomogram 


L(0) (0) 
Fh ———— 

h m—k B. & P. Nom. m—I: B. & P. Nom. 
4:10 — 0-50 376 370 0-50 8-92 8-85 
2-70 —0-75 282 274 0-75 4-28 4:32 
3-21 —0°75 580 580 0-75 4-99 5:05 
3-50 — 0°75 912 920 0-75 5:37 5-42 
1-97 — 1-00 246 240 1-00 2-71 2-70 
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Table of Neyman-shortest unbiased confidence intervals for the 
binomial parametert 


By COLIN R. BLYTH anp DAVID W. HUTCHINSON 


University of Illinois, Urbana, Illinois 


1. Introduction and summary. A random subset A of the possible values of a parameter 0 
is by definition an unbiased «-confidence set for 0 if 


P,(@¢eA)>a, allO 
P,(0’¢ A) < P,(@¢€ A), all pairs 0,0’. 


A uniformly Neyman-shortest member of this class is one which minimizes P,(6’ € A) 
for all pairs 0,0’. Such a set is optimum in the sense that among all unbiased «-confidence 
sets it uniformly minimizes the probability of covering false values. These concepts were 
introduced and construction methods given by Neyman (1937). When such a confidence 
set is to be based on a discrete random variable, randomization is needed for its construction; 
see Eudey (1949), Pearson (1950), Tocher (1950) and Stevens (1950). The Neyman-shortest 
unbiased confidence set for the binomial parameter was obtained by Eudey (1949); the 
purpose of the present note is to provide tables of this set. 


2. Use of the tables. Let X be binomial (n, p) and Y be rectangular (0,1) with X and Y 
independent. If X = x and Y = y (using a table of random numbers) are observed, enter 
the a-table at the location n, x + y and read there the observed a-confidence set for p. If then, 
x+y location is not tabled, enter the table at location n, n + 1— (x+y) and use the reflexion 
about p = 4 of the set given there. Tables are given for a = 0-95, 0-99 and n = 2(1) 24(2) 50. 
Intervals for n = 25, 27, ..., 49 can be found by interpolation. The sets are intervals whose 
end-points are given to two decimal places; rounding-off errors are small compared to the 
lengths of the intervals. 

Example. If n = 21, X = 12, Y = 0-73, enter the table at n = 21,n+1-—(X+ Y) = 9-27. 
Interpolating, we see that the 0-99 confidence interval is 1 — 0-69, 1— 0-17 = 0-31, 0-83. 


3. Comparison with existing tables The confidence intervals of Clopper & Pearson (1934) 
are obtained from tests whose rejection regions consist of two tails with approximate 
probability }(1—«a) each. These confidence sets are non-randomized and so give coverage 
probabilities in excess of « at the expense of being larger than necessary to achieve probability 
a of coverage. The corresponding randomized intervals based on tests whose rejection 
regions consist of two tails with exact probability }(1—«) each are easily computed—see 
Stevens (1950)—using a desk calculator and tables of the binomial distribution. These 
confidence sets are very reasonable and though they have no particular optimum property, 
are not likely to be much improved upon. 

The confidence sets given by Crow (1956) are based on tests whose acceptance regions are 
made up of the most probable points. The resulting confidence sets have the property that 


among all non-randomized confidence intervals they minimize the sum of the n + 1 possible 
lengths. 


+ Work supported by the National Science Foundation. 
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The Eudey intervals tabled here include the advantage of randomization and are optimum 
in the sense of being Neyman-shortest unbiased. 

In the following figure the Clopper-Pearson, Stevens, Crow and Eudey 0-95-confidence 
intervals are compared for n = 10. Corresponding to a given X+ Y value the various 
confidence limits are read off as vertical intercepts. 

This comparison shows the Stevens interval to be shorter than Eudey’s for 


16<X+Y<94 


and the reverse for other values of X + Y. Since shortness in the sense of ordinary length is 
not necessarily desirable (it seems undesirable when the interval fails to cover p) corre- 
sponding preferences for Stevens v. Eudey intervals do not necessarily follow. 
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Fig. 1. 0-95-confidence intervals for p based on X, binomial (10, ) and an independent Y, 
rectangular (0, 1). 


4. Construction of the tables Let X be Binomial (n, p) and Y be Rectangular (0, 1), with 
X and Y independent. Eudey (1949) showed that a uniformly most powerful unbiased level 
1—a test of p = p* vs.p + p*, based on X, is given by the acceptance region a(p*) deter- 
mined by 


a(p*) = {x y:Mg+¥o < X+Y < m+}, 

0<7y,<1, 
[Pi(m+V%o < X+Y¥ < m+) pape = & 

[(d/dp) P, (mo + ¥o < X+Y <m+7)|p_pe = 0. 


No, Nyintegers, 0 < y) <1, 
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These equations for m9, ”,, Yo, Y, reduce to: 
N,N, integers; O<y,<1, O<y, <1, 
(n, —np*) {F,+(n% < x < n,—1)—a}—n,(1 —p*) P(X = Np) + 2, (1 —p*) P(X =) 
(n1 — Mp) P(X = Np) ‘ 
— (Mo— MP*) {Finely < X < m—1)— a} — mo(1 — p*) Fye(X = Mo) + (1 —P*) Fye(X = m) 


= we Se eae es Esa! 


(my — Mo) Pyo(X = 4) 





Yo= 





The unique solvability of these equations follows from obvious continuity and monotonicity 
considerations. The Neyman—Pearson lemma with side conditions shows that the uniformly 
most powerful, level 1—«a, test is unique except for the way in which randomization is 
carried out. The equations are solved by using trial values for 7, n, until the resulting 
Yo Y1 are both on [0,1]. Solution of the equations was carried out using the University of 
Illinois Digital Computer Laboratory’s ILLIAC. A program was constructed which for 
arbitrary 7, « prints out %») + Yo, 2, +7; for any equally spaced set of p* values. The p* values 
used were 0-005, 0-015, ..., 0-995. The Neyman-shortest unbiased a-confidence set 


A(X, Y) = {p*:X+Y € a(p*)} 


for p, can then be read off to two places from the n)+ 7», n+, print-out. 
Tables of Neyman-shortest unbiased «-confidence sets for a Poisson parameter are being 
constructed in the same way. 


REFERENCES 


CiLoprEr, C. J. & Pearson, E. S. (1934). The use of confidence or fiducial limits illustrated in the case 
of the binomial. Biometrika, 26, 404. 

Crow, E. L. (1956). Confidence intervals for a proportion. Biometrika, 43, 423. 

Eupey, M. W. (1949). On the treatment of discontinuous random variables. Technical Report No. 13, 
Statistical Laboratory, University of California, Berkeley. 

NreymMan, J. (1937). Outline of a theory of statistical estimation based on the classical theory of 
probability. Phil. Trans. A, 236, 333. 

Pearson, E. S. (1950). On questions raised by the combination of tests based on discontinuous 
distributions. Biometrika, 37, 383. 

Srevens, W.L. (1950). Fiducial limits of the parameter of adiscontinuousrandom variable. Biometrika, 
37, 117. 

TocueEr, K. D. (1950). Extension of Neyman-—Pearson theory of testing hypotheses to discontinuous 
variates. Biometrika, 37, 130. 


- 





384 Cotin R. BtytH anp Davin W. HuTCHINSON 


Table 1. Neyman-shortest unbiased 0-95-confidence intervals for p based on X, Binomial 


(n, p) and an independent Y, Rectangular (0, 1) 


n= n=3 n=4 n= 5 n= n= 7 n=8 n=9 n= 10 
a — —— — —_—— a ca ——— m— x+Y 
00 00 00 00 00 00 00 00 Ov 00 00 00 00 00 00 00 00 00 0 
00 50 00 29 00 23 00 18 00 15 00 13 00 11 00 10 00 09 0-1 
00 75 00 50 00 37 00 31 00 26 00 23 00 20 00 18 00 16 2 
00 83 00 59 00 45 00 38 00 32 00 28 00 25 00 22 00 20 3 
00 87 00 65 00 50 00 42 00 35 00 31 00 28 00 25 00 23 “4 
00 90 00 68 00 54 00 44 00 38 00 34 00 30 00 27 00 25 5 
00 92 00 71 00 56 00 46 00 41 00 36 00 32 00 29 00 26 6 
00 93 00 73 00 59 00 48 00 42 00 37 00 33 00 30 00 27 “7 
00 94 00 75 00 60 00 50 00 44 00 39 00 34 00 31 00 29 8 
00 94 00 76 00 62 00 51 00 45 00 40 00 35 00 32 00 30 9 
00 95 00 78 00 63 00 53 00 46 00 41 00 36 00 33 00 30 1-0 
00 1-0 00 85 00 69 00 58 00 50 00 44 00 40 00 36 00 33 1-1 
00 1-0 00 89 00 73 00 62 00 53 00 47 00 42 00 38 00 35 1-2 
00 10 00 92 00 77 00 65 00 56 00 50 00 45 00 40 00 37 1-3 
00 1-0 00 94 00 79 00 67 00 58 00 52 00 46 00 42 00 39 1-4 
00 1-0 00 95 00 81 00 69 00 60 00 53 00 48 00 44 00 40 15 
00 96 00 83 00 71 00 61 00 55 00 49 00 45 00 41 1-6 
00 96 00 84 00 72 00 63 00 56 00 50 00 46 00 42 1-7 
00 97 00 85 00 73 00 64 00 57 00 51 00 47 00 43 1-8 
00 97 00 86 00 74 00 65 00 58 00 52 00 48 00 44 1-9 
03 97 02 86 Ol 75 Ol 66 Ol 58 Ol 53 Ol 48 Ol 44 2-0 
02 90 Ol 79 Ol 69 Ol 61 Ol 55 01 50 Ol 46 2-1 
02 93 02 81 Ol 71 Ol 63 Ol 57 Ol 52 Ol 48 2-2 
02 95 02 83 Ol 73 Ol 65 Ol 59 Ol 54 01 50 23 
03 96 02 85 02 75 Ol 67 01 60 Ol 55 ol 51 2-4 
03 «97 03 86 02 #77 02 68 Ol 62 Ol 57 Ol 52 2-5 
03 «88 02 78 02 69 02 63 02 58 01 53 2-6 
04 88 03 «#79 03 «+70 02 63 02 59 02 54 2-7 
05 89 04 80 03 #71 03 64 03 59 02 55 2-8 
07 90 06 80 05 72 04 65 03 «60 03 55 2-9 
10 90 08 81 06 73 05 66 05 61 04 56 3-0 
08 84 07 75 06 68 05 62 04 58 3-1 
09 86 07 +77 06 70 05 64 05 59 3-2 
09 87 07 #79 06 71 06 65 05 60 3:3 
10 88 08 80 07 #73 06 66 05 62 3-4 
ll 89 09 81 07 74 06 67 06 63 3-5 
09 82 08 75 07 68 06 63 3-6 
ll 83 09 75 08 69 07 64 3-7 
12 84 10 76 09 70 08 65 3:8 
13 84 ll 77 10 70 09 65 3-9 
15 85 13 (77 Se | 10 66 4-0 
13 79 12 73 10 67 4-1 
14 81 12 74 ll 69 4-2 
14 82 12 75 11 70 4:3 
15 83 13. (77 ll 71 4-4 
16 84 14 77 12 72 4:5 
14 78 13 72 4-6 
15 79 14 73 4-7 
16 80 14 74 4:8 
18 80 16 74 4-9 
19 81 17. (75 5-0 
17 76 51 
18 78 5-2 
18 79 5:3 
19 79 5-4 
20 80 5:5 


Note : the pairs of figures are lower and upper confidence limits for p, given to two places of decimals. 
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Table 1 (cont.) 


e = i} n= 12 n= 13 n= 14 n= 15 n= 16 n=17 n= 18 n=19 
mmm a, oo a a... =a meas. X+Y 
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 Ol 00 0 0 
00 08 00 08 00 07 00 07 00 06 00 06 00 05 00 05 00 05 0-1 
00 15 00 14 00 13 00 12 00 ill 00 10 00 10 00 09 00 09 2 
00 19 00 17 00 16 00 15 00 14 00 13 00 12 00 12 00 11 3 
oo 21 00 19 v0 18 00 17 00 16 00 15 00 14 00 13 00 13 4+ 
00 23 00 21 00 19 00 18 00 #17 00 16 00 15 00 14 00 14 5 
00 24 00 22 00 21 00 19 00 i8 00 #17 00 16 00 15 00 15 6 
00 25 00 23 00 22 00 20 00 19 00 18 00 #17 00 16 00 15 7 
00 26 00 24 00 23 00 21 00 20 00 19 00 i8 00 #417 00 16 8 
00 27 00 25 00 23 00 22 00 21 00 19 00 #18 00 #417 00 #417 9 
00 28 00 26 00 24 00 22 00 21 00 20 00 19 00 #18 00 #17 1-0 
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16 72 14 68 13 64 12 60 ll 57 10 54 10 52 09 49 08 47 5 
17 74 15 70 14 66 13. 62 12 59 ll 56 10 53 10 51 09 48 5 
18 76 16 71 15 67 14 63 13 60 12 57 ll 54 10 52 10 50 5 
20 77 18 72 16 68 15 64 14 61 13. 58 12 55 ll 53 11 50 5 
22 78 20 73 18 69 17 65 15 62 14 59 13. 56 12 54 12 51 6 
21 75 19 71 17 67 16 64 15 61 14 58 13. 55 12 53 6 

22 77 20 73 18 69 17 65 16 62 14 59 14 56 13. 54 6 

23 «78 21 74 19 7 18 66 16 63 15 60 14 58 14 55 6 

23 «75 21 71 19 67 18 64 16 61 15 58 14 56 6 

24 76 22 72 21 68 19 65 18 62 17 59 16 57 7 

23 «74 21 70 20 67 18 63 17 ‘61 16 58 7 

24 75 22 71 21 68 19 65 18 62 17 59 7 

25 76 23 «+72 21 69 20 66 19 63 18 60 7 

24 73 23 70 21 67 20 64 18 61 7 

26 74 24 71 22 68 21 65 20 62 8 

25 72 23 «69 21 66 20 63 8-2 

26 73 24 70 22 67 21 64 8-4 

27 «+74 25 71 23. «68 22 65 8-6 

26 72 24 69 23 «66 8-8 

27 73 26 70 24 67 9-0 

26 71 25 68 9-2 

27 72 25 69 9-4 

28 73 26 70 9-6 

27 «(71 9-8 

28 72 100 


Note: the pairs of figures are lower and upper confidence limits for p, given to two places of decimals. 
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Table 1 (cont.). 0-95 confidence intervals 


n = 20 n= 2) n = 22 n = 23 n = 24 n = 26 n = 28 n = 30 n = 32 n : 
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0 00 


00 14 00 13 00 13 00 12 00 12 00 11 00 10 00 09 00 09 6 00 
00 15 00 14 00 13 00 13 00 12 00 11 00 11 00 10 00 09 7 00 
00 15 00 15 00 14 00 13 00 13 00 12 00 11 00 10 00 10 8 00 
00 16 00 15 00 14 00 14 00 13 00 12 00 12 00 11 00 10 9 00 
00 16 00 16 00 15 00 14 00 14 00 13 00 12 00 11 00 10 1-0 0c 
00 19 00 18 00 17 00 «#17 00 16 00 15 00 14 00 13 00 12 1-2 oC 
00 21 00 20 00 #19 00 18 00 18 00 16 00 15 00 14 00 13 1-4 0] 
00 22 00 21 00 20 00 20 00 19 00 18 00 16 00 15 00 14 1-6 0] 
00 24 00 23 00 22 00 21 00 20 00 19 00 17 00 16 00 15 1-8 0: 
00 24 00 23 00 22 00 22 00 21 00 #19 00 18 00 #17 00 16 2-0 0% 
00 27 00 25 00 24 00 23 00 22 00 21 00 20 00 #18 00 17 2-2 04 
00 28 00 27 00 26 00 25 00 24 00 22 00 21 00 19 00 18 2-4 0: 
01 29 01 28 Ol 27 Ol 26 Ol 25 00 23 00 22 00 20 00 19 2-6 Of 
01 31 Ol 29 01 28 Ol 27 Ol 26 Ol 24 Ol 23 01 21 01 20 2-8 0’ 
02 31 02 30 02 29 02 28 02 27 Ol 25 Ol 23 01 22 01 20 3-0 0! 
02 33 02 32 02 3i 02 29 02 28 02 26 Ol 25 01 23 01 22 3-2 0! 
02 35 02 33 02 32 02 31 02 29 02 27 02 26 02 24 Ol 23 3-4 1 
03 36 03 34 03 33 02 32 02 3i 02 28 02 27 02 25 02 23 3-6 1 
03 37 03 35 03 34 03 «33 03 «31 03 29 02 27 02 26 02 24 3-8 Li 
04 38 04 36 04 35 04 33 04 32 03 «30 03 28 03 26 03 25 4-0 1 
05 39 05 38 04 36 04 35 04 34 04 31 03 29 03 27 03 26 4-2 1 
05 41 05 39 05 37 04 36 04 35 04 32 04 30 03 28 03 27 4-4 1 
06 42 05 40 05 39 05 37 05 36 04 33 04 31 04 29 03 28 4-6 1 
07 43 06 41 06 39 06 38 05 36 05 34 05 32 04 30 04 28 4-8 1 

08 44 O07 42 07 40 06 39 06 37 06 35 05 32 05 31 05 29 5-0 1 
08 45 08 43 07 42 07 40 07 39 06 36 06 34 05 32 05 30 5-2 2 
08 46 08 45 08 43 07 41 07 40 06 37 06 35 05 33 05 31 5-4 2 
09 47 09 46 08 44 08 42 07 41 07 38 06 35 06 33 05 31 5-6 | 2 
10 48 09 46 09 45 09 43 08 41 07 39 07 36 06 34 06 32 5:8 2 
ll 49 10 47 10 45 09 44 09 42 08 39 08 37 07 35 07 33 6-0 2 
12 52 12 50 ll 48 ll 46 10 45 09 42 09 39 08 37 07 35 6-5 2 
15 54 14 52 13 50 13. 48 12 47 ll 44 10 41 09 38 09 36 7-0 2 
16 57 15 55 15 53 14 51 13. 49 12 46 ll 43 10 41 10 38 75 3 
18 59 17 (57 17 55 16 53 15 51 14 48 13. 45 12 42 ll 40 8-0 3 
20 62 19 60 18 58 17 56 16 54 15 50 14 47 13 44 12 42 8-5 3 
23 «64 21 62 20 60 19 57 18 55 17 52 15 49 14 46 13 43 9-0 3 
24 67 23 «464 22 62 21 60 20 58 18 54 7 51 15 48 14 45 9-5 


Note: the pairs of figures are lower and upper confidence limits for p, given to two places of decimals. 
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Table 1 (cont.) 


ai ' as Coa,  ahaliaaee. sy y aes. Gata, ay —— X+Y 
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00 05 00 05 00 05 00 04 00 04 00 04 00 04 00 04 00 03 0-2 
00 07 00 07 00 06 00 06 00 06 00 06 00 05 00 05 00 05 4 
00 08 00 08 00 08 00 07 00 07 00 07 00 06 00 06 00 06 6 
00 09 00 09 00 08 00 08 00 08 00 07 00 07 00 07 00 06 8 
00 10 00 09 00 09 00 08 00 08 00 08 00 07 00 07 00 07 1-0 
00 12 00 11 00 10 00 «10 00 09 00 09 00 09 00 08 00 08 1-2 
00 13 00 12 00 11 00 11 00 10 00 10 00 10 00 09 00 09 1-4 
00 14 00 #13 00 12 00 12 00 11 00 11 00 10 00 10 00 09 1-6 
00 14 00 14 00 13 00 12 00 12 00 11 00 11 00 10 00 10 1-8 
00 15 00 14 00 13 00 13 00 12 00 12 00 11 00 11 00 10 2-0 


00 18 00 17 00 16 00 15 00 15 00 14 00 13 00 13 00 12 2-5 
Ol 19 01 18 Ol 17 Ol 17 01 16 Ol 15 Ol 15 Ol 14 01 13 3-0 
01 22 01 21 01 20 01 19 01 18 01 17 01 16 01 16 Ol 15 3-5 
03 23 02 22 02 21 02 20 02 19 02 18 02 «18 02 17 02 16 4-0 
03 26 03 24 03 23 03 22 02 21 02 20 02 19 02 19 02 18 4:5 
04 27 04 26 04 25 04 23 03 22 03 «21 03 21 03 20 03 «#19 5-0 
05 29 05 28 04 27 04 25 04 24 04 23 04 22 03 21 03 21 5:5 
06 31 06 29 05 28 05 27 05 25 05 24 04 23 04 22 04 22 6-0 
07 33 07 31 06 30 06 28 06 27 05 26 05 25 05 24 05 23 6-5 
08 34 08 33 07 31 07 30 07 28 06 27 06 26 06 25 05 24 7-0 
09 36 09 35 08 33 08 31 07 30 07 29 07 28 06 27 06 26 7-5 
10 38 10 36 09 34 09 33 08 31 08 30 08 29 07 28 07 27 8-0 
11 40 10 38 10 36 09 34 09 33 08 31 08 30 08 29 07 28 8-5 
12 41 12 39 ll 37 10 36 10 34 09 33 09 31 09 30 08 29 9-0 
13 43 13 41 12 39 ll 37 ll 36 10 34 10 33 09 31 09 30 9-5 
15 44 14 42 13 40 12 38 12 37 ll 35 ll 34 10 33 10 31 10-0 
16 46 15 44 14 42 13 40 12 38 12 37 ll 35 ll 34 10 33 10-5 
17 47 16 45 15 43 14 41 14 39 13 38 12 36 12 35 1l 34 11-0 
18 49 17 47 16 45 15 43 14 41 14 39 13 38 12 36 12 35) 11-5 
19 51 18 48 17 46 16 44 15 42 15 40 14 39 13 37 13 36 =12-0 
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27 59 25 57 24 54 22 52 21 50 20 48 19 46 18 44 18 42 15:0 
28 61 26 58 25 56 23 «53 22 51 21 49 20 47 19 45 18 44 15:5 
30 62 28 59 26 57 25 54 23 «52 22 50 21 48 20 46 19 45 16-0 
31 64 29 61 27 «58 26 56 24 53 23 «51 22 49 21 47 20 46 16-5 
32 65 30 62 28 59 27° «+57 25 54 24 52 23 50 22 48 21 47 17-0 
33 67 31 64 29 61 28 58 26 56 25 54 24 52 23 «50 22 48 17-5 
35 «68 33 65 31 62 29 59 28 57 26 55 25 52 24 51 23 49 18-0 
34 66 32 63 30 «(61 28 58 27 56 26 54 25 52 23 50 18-5 
35 67 33 «64 31 62 30 59 28 57 27 «+55 26 53 24 51 19-0 
34 66 32 63 31 60 29 58 28 56 26 54 25 52 195 

36 67 34 64 32 61 30 59 29 57 27 «+55 26 53 20. 


Note: the pairs of figures are lower and upper confidence limits for p, given to two places of decimals. 





388 Cotin R. BiuytH anp Davin W. HutTcHINsSoN 


Table 2. Neyman-shortest unbiased 0-99-confidence intervals for p based on X, binomial 
(n, p) and an independent Y, rectangular (0, 1) 


n= 2 n= 3 n=4 n=5 n=6 n=7 n=8 n=9 n= 10 00 
i -__ —— mica, —_"— a a__ “__ a X4+Y 00 

00 00 00 00 00 00 «600 00) «6©00 00)=6—00 :00=—S (00 «00——«CétODs«Hsi—istéi 
00 90 00 68 00 54 00 44 400 37 00 33 00 29 00 26 00 24 Ol 00 
00 95 OO 78 00 638 00 53 00 45 00 40 00 36 00 32 #00 30 2 00 
00 97 00 82 00 68 00 57 00 49 00 44 00 39 00 36 8 00 33 3 00 
00 98 00 84 00 71 00 60 00 52 00 46 00 42 00 38 00 35 4 00 
00 98 00 86 00 73 00 62 00 54 00 48 00 43 00 39 00 36 5 - 
00 98 00 87 00 74 00 64 00 56 00 49 00 45 00 41 00 38 6 oC 
00 99 00 88 00 76 00 6 00 57 00 51 00 46 00 42 8 00 39 7 oC 
00 99 00 89 00 77 400 67 00 58 00 52 00 47 00 43 #00 39 8 oC 
00 99 00 89 00 78 «00 68 00 59 «69600 53)—=— (00 48—Ssi«Os«44—Ss«s« 40 9 oC 
00 99 00 90 00 78 00 68 00 60 00 54 00 49 00 44 00 41+ «10 
00 10 00 96 00 84 00 74 00 6 00 58 00 52 00 48 00 44 Ld o 
00 10 00 98 00 88 00 77 400 68 00 61 00 55 00 51 00 47 12 of 
00 10 00 98 00 90 00 79 00 71 00 68 00 57 00 52 00 48 13 0 
00 10 00 99 00 91 OO 81 00 72 00 6 00 59 00 54 00 50. 1-4 Oo 
00 10 00 99 00 92 00 82 00 74 00 66 00 60 00 55 00 51 15 . 
00 99 00 92 00 83 00 75 00 67 00 61 00 56 00 52 16 oO 
00 99 00 93 00 84 00 76 00 68 00 62 00 57 00 53. 1-7 o 
00 99 00 93 00 85 00 77 400 69 00 63 00 58 00 54° 18 of 
00 99 00 94 00 85 00 77 00 70 00 64 00 58 00 54 149 : 
01 99 00 94 00 86 00 78 00 71 00 64 00 59 00 55 20 ; 
4 
‘ 
00 97 00 89 00 81 00 74 00 67 00 62 00 57. 21 
00 98 OO 91 00 838 00 76 00 69 00 64 00 59 22 : 
00 99 00 93 00 8 00 77 400 71 00 6 00 60 23 03 
01 99 00 93 00 86 00 79 00 72 00 66 00 61 2-4 0% 
01 99 O1 94 400 87 00 80 00 73 00 67 00 62) 25 ‘ 
01 95 00 88 00 80 00 74 00 68 00 63 26 O 
01 95 Ol 88 O1 81 00 75 00 69 00 64 27 of 
01 95 Ol 89 «Ol 82 O1 75 Ol 70 Ol 65 28 - 
02 96 O2 89 Ol 82 O1 76 OL 70 O1 65 29 0 
04 96 O03 89 03 83 02 76 O02 71 02 66 3-0 . 
03 92 03 8 02 79 02 73 02 68 31 L 
04 93 03 87 03 80 02 74 02 69 32 1 
04 94 O83 88 03 81 02 76 02 70 33 + 
04 95 O03 89 03 82 O08 77 02 71 34 

05 95 #04 89 O08 838 03 77 02 72 365 

04 90 04 84 03 78 083 73 36 

05 90 04 84 O08 79 038 74 37 

05 91 05 8 04 79 04 74 38 

07 91 406 8 05 80 04 75 39 

08 92 O07 86 06 80 05 75 40 

07 88 06 82 06 77) 41 

08 89 O07 83 06 78 42 

08 90 07 84 06 79 43 

08 91 O07 85 06 80 4-4 

09 91 08 86 O07 81 45 

08 86 O07 81 46 

09 87 08 82 47 

10 87 08 82 48 

11 88 09 838 49 

12 88 11 838 50 

11 84 5&1 

1l 85 652 

ll 86 53 

12 87 54 

12 88 6&5 


Note; the pairs of figures are lower and upper confidence limits for p, given to two places of decimals. nN 





Confidence intervals for the binomial parameter 389 


Table 2 (cont.) 


00 22 00 20 00 19 00 18 00 17 00 16 00 15 00 14 00 13 0-1 
00 27 00 25 00 23 00 22 00 21 00 19 00 18 00 17 00 17 2 
00 30 00 28 00 26 00 24 00 23 00 22 00 20 00 19 00 18 3 
00 32 00 30 00 28 00 26 00 24 00 23 00 22 00 21 00 20 4 
00 34 00 31 00 29 00 27 00 26 00 24 00 23 00 22 00 21 5 
00 35 00 32 00 30 00 28 00 27 00 25 00 24 00 23 00 22 6 
00 36 00 33 00 31 90 29 00 27 00 26 00 25 00 23 00 22 7 
00 37 00 34 00 32 co 30 00 28 00 27 00 25 00 24 00 23 8 
00 37 00 35 00 32 00 31 00 29 00 27 00 26 00 25 00 23 9 
00 38 00 35 00 33 ” 31 00 29 00 28 00 26 00 25 00 24 1-0 
00 43 00 40 00 38 00 35 00 33 00 32 00 30 00 29 00 27 1-2 
00 46 00 43 00 41 00 38 00 36 00 34 00 32 00 31 00 29 1-4 
00 48 00 45 00 42 00 40 00 38 00 36 00 34 00 32 00 31 1-6 
00 50 00 47 00 44 00 41 00 39 00 37 00 35 00 33 00 32 1-8 
00 51 00 48 00 45 00 42 00 40 00 38 00 36 00 34 00 33 2-0 
00 55 00 51 00 48 00 46 00 43 00 41 00 39 00 37 00 35 2-2 
00 57 00 54 00 51 00 48 00 45 00 43 00 41 00 39 00 37 2-4 
00 59 00 55 00 52 00 49 00 47 00 44 00 42 00 40 00 38 2-6 
00 60 00 57 00 53 00 50 00 48 00 45 00 43 00 41 00 39 2-8 
02 «61 Ol 58 Ol 54 01 51 01 49 Ol 46 Ol 44 Ol 42 01 40 3-0 
02 64 02 61 Ol 57 Ol 54 Ol 51 Ol 49 Ol 46 Ol 44 Ol 42 3-2 
02 67 02 63 02 59 02 56 01 53 01 50 01 48 01 46 Ol 44 3-4 
02 68 02 64 02 61 02 57 02 54 02 52 01 49 Ol 47 Ol 45 3-6 
03 «69 03 65 03 62 02 58 02 55 02 53 02 50 02 48 02 46 3°8 
05 70 04 66 04 63 04 59 03 56 03 54 03 «51 03 49 03 47 4-0 
05 73 05 69 04 65 04 62 04 59 03 56 03 53 03 51 03 49 4-2 
06 75 05 71 05 67 04 63 04 60 04 57 03 55 03 52 03 50 4-4 
06 76 06 72 05 68 05 65 04 61 04 59 04 56 04 53 03 51 4-6 
07 #77 07 73 06 69 06 66 05 62 05 59 04 57 04 54 04 52 4-8 
09 78 08 74 08 70 07 66 06 63 06 60 06 58 05 55 05 53 5-0 
10 81 09 76 08 72 07 68 07 65 06 62 06 59 05 57 05 55 5-2 
ll 82 09 78 09 74 08 70 07 67 O7 64 06 «61 06 58 06 56 5-4 
ll 83 10 79 09 75 09 71 08 68 07 65 07 62 06 59 06 57 5-6 
13 84 11 80 10 76 10 72 09 69 08 66 08 63 07 60 07 58 5:8 
15 85 13 81 12 77 ll 73 10 69 09 66 09 63 08 61 08 58 6-0 
14 83 13 79 12 75 ll 71 10 68 09 65 09 63 08 60 6-2 

15 84 13. 80 12 76 ll 73 10 69 10 66 09 64 08 61 6-4 

16 85 14 81 13 77 12 74 11 70 10 67 10 65 09 62 6-6 

16 82 14 78 13. 74 12 71 1l 68 10 65 10 63 6-8 

17 83 16 79 15 75 13 72 13 69 12 66 ll 64 7-0 

16 81 15 77 14 74 13 (71 12 68 ll 65 7-2 

17 82 16 78 15 75 14 72 13 69 12 66 7-4 

18 83 17 79 15 76 14 73 13 70 12. 67 7-6 

18 80 16 77 15 73 14 71 13 68 7:8 

19 81 18 77 17 74 16 71 15 68 8-0 

19 79 17 76 16 73 15 70 8-2 

19 80 18 77 17 74 16 71 8-4 

20 81 19 78 17 75 16 72 8-6 

20 78 18 75 17 73 8-8 

21 79 20 76 18 73 9-0 

20 77 19 74 9-2 

21 78 20 75 9-4 

22 79 20 76 9-6 

21 77 9-8 

23 77 10-0 


Note : the pairs of figures are lower and upper confidence limits for p, given to two places of decimals. 
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Table 2 (cont.). 0-99 confidence intervals 


a, ——s, pee, — 7 ———, ez — Xx+Y — 
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 0 00 
00 13 00 12 00 12 00 11 00 iil 00 10 00 09 00 09 00 08 0-1 00 
00 i6 00 15 00 14 00 14 00 13 00 12 00 12 00 11 00 10 2 00 
00 18 00 17 00 16 00 16 00 15 00 14 00 13 00 12 00 11 3 00 
00 19 00 18 00 17 00 17 00 16 00 15 00 14 00 13 00 12 4 00 
00 20 00 19 00 18 00 17 00 17 00 16 00 15 00 14 00 13 5 00 
00 21 00 20 00 #19 00 18 00 17 00 16 00 15 00 14 00 13 6 00 
00 21 00 20 00 20 00 19 00 18 00 17 00 16 00 15 00 14 7 00 
00 22 00 21 00 20 00 #19 00 19 00 17 00 16 00 15 00 14 8 00 
00 22 00 21 00 21 00 20 00 19 00 18 00 16 00 15 00 15 9 00 
00 23 00 22 00 21 00 20 00 19 00 18 00 17 00 16 00 15 1-0 00 
00 26 00 25 00 24 00 23 00 22 00 21 00 19 00 18 00 17 1-2 00 
00 28 00 27 00 26 00 25 00 24 00 22 00 21 00 20 00 18 1-4 00 
00 29 00 28 00 27 00 26 00 25 00 23 00 22 00 21 00 19 1-6 01 
00 31 00 29 00 28 00 27 00 26 00 24 00 23 00 21 00 20 1:8 01 
00 31 00 30 00 29 00 28 00 27 00 25 00 23 00 22 00 21 2-0 02 
00 34 00 32 00 31 00 30 00 29 00 27 00 25 00 24 00 22 2-2 03 
00 36 00 34 00 33 00 32 00 30 00 28 00 27 00 25 00 24 2-4 03 
00 37 00 35 00 34 00 33 00 31 00 29 00 27 00 26 00 24 2-6 04 
00 38 00 36 00 35 00 34 00 32 00 30 00 28 00 27 00 25 2-8 05 
01 39 Ol 37 01 36 Ol 34 Ol 33 01 31 01 29 Ol 27 00 26 3-0 0€ 
Ol 41 01 39 Ol 37 01 36 Ol 35 Ol 32 01 30 01 29 Ol 27 3-2 0€ 
Ol 42 01 40 01 39 Ol 37 Ol 36 Ol 34 Ol 32 01 30 01 28 3-4 0" 
Ol 43 Ol 42 01 40 Ol 38 Ol 37 Ol 35 Ol 32 01 31 01 29 3°6 08 
02 44 02 42 Ol 41 Ol 39 Ol 38 Ol 35 01 33 01 31 01 30 3-8 os 
02 45 02 43 02 42 02 40 02 39 02 36 02 34 02 32 01 30 4:0 1( 
03 47 02 45 02 43 02 42 02 40 02 38 02 35 02 33 02 3i 4-2 1] 
03 48 03 46 03 44 02 43 02 41 02 39 02 36 02 34 02 32 4:4 
03 49 03 47 03 46 03 44 03 42 02 40 02 37 02 35 02 33 4-6 1: 
04 51 04 48 03 46 03 45 03 43 03 40 03 «38 02 36 02 34 4:8 1 
05 51 04 49 04 47 04 45 04 44 03 41 03 38 03 36 03 34 5-0 lf 
05 52 05 50 04 49 04 47 04 45 04 42 03 40 03 37 03 35 5-2 1’ 
05 54 05 52 05 50 04 48 04 46 04 43 04 41 03 «38 03 36 5-4 li 
06 55 05 53 05 51 05 49 05 47 04 44 04 41 04 39 03 37 5-6 / 1 
06 55 06 53 06 51 05 50 05 48 05 45 04 42 04 40 04 38 58 2 
07 56 07 54 O7 52 06 50 06 49 05 45 05 43 05 40 04 38 6-0 2 
08 59 08 57 07 55 07 53 07 51 06 48 06 45 05 43 05 40 6-5 2 
10 61 10 59 09 57 09 55 08 53 08 50 O07 47 O7 44 06 42 7-0 2 
ll 64 ll 62 10 60 10 58 09 56 08 52 08 49 O07 47 O7 44 7-5 2 
14 66 13 64 12 61 12 59 ll 57 10 54 09 51 09 48 08 45 8-0 2 
15 69 14 66 13. 64 13 62 12 60 1l 56 10 53 09 50 09 48 8-5 2 
17 70 16 68 15 66 15 64 14 62 13 58 12 55 ll 52 10 49 9-0 2 
19 73 18 71 17 68 16 66 15 64 14 60 13 57 12 54 ll 51 9-5 3 
21 75 20 72 19 70 18 68 17 66 16 62 14 58 13. 55 12 52 10-0 
23 «77 21 75 20 72 19 70 18 68 17 64 15 60 14 57 13 54 105 

24 76 22 74 21 72 20 69 18 65 17 62 16 58 15 56 11-0 


Note; the pairs of figures are lower and upper confidence limits for p, given to two places of decimals. : 
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Table 2 (cont.) 
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Note: the pairs of figures are lower and upper confidence limits for p, given to two places of decimals. 
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On the power function of the exact test for the 
2x2 contingency table 


By B. M. BENNETT anv P. HSU 
University of Washington, Seattle 


1. Introduction. For the 2 x 2 table which consists of N(= A+B) individuals in two 
groups 


With Without 
Group attribute attribute Total 
1 a A-a A 
2 b B-b B 
Total r=a+b N-r N 


classified according to whether or not they possess a certain character or attribute C, an 
exact test of significance for the hypothesis H,: p, = p, of the equality of the respective 
population proportions of individuals possessing C was devised concurrently by Yates 
(1934) and Fisher (1935). Under the null hypothesis H, they demonstrated that the condi- 
tional probability that a of the individuals in the array above with fixed marginal totals 
r, A, B possess the attribute is given by the successive terms of the hypergeometric 


distribution 4) ; i ( a 


f(a|r) = "5 _ (1) 
7 

where r = a+b, a = max(0,r—B), max (0,r—B)+1,..., min(r, A), or b = max (0,r—A), 
max (0,r—A)+1,..., min(r, B). In terms of b we may write the distribution as 


A\(B 
(,=1)(s) 
— 
(;) 
For the exact test, the probabilities (1) are then to be summed over the given observed or 
more extreme values of a, or b in (2). 


For small frequencies, significant values of } in particular have been provided, i.e. the 
critical values 6, such that 


bo 
Ph <blr}= = flblr)<a and Plo <b +1l|r} >a. 
b=0 





f(6|r) = (2) 


For nominal levels of significance a = 0-05, 0-025, 0-01, 0-005, Finney (1948) has computed 
b, for B < A < 15, and Latscha (1953) has supplemented these when B < A < 20. The 
present authors have recently extended these exact probabilities to the cases B < A < 25. 
The particular arrangement of these tables is mainly concerned with one-sided alternatives: 
P; > po. For two-sided alternatives of the form: p, + p., the tabular exact probabilities 
are accordingly to be doubled. 
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Fig. 1. Power contours (A = 5, B = 5). 
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Fig. 3. Power contours (A = 10, B = 5). 
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Fig. 5. Power contours (A = 15, B = 10). 
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Fig. 2. Power contours (A = 10, B = 10). 
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Fig. 4. Power contours (A = 15, B = 15) 
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Fig. 6. Power contours (A = 15, B = 5). 
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Fig. 9. Power contours (A = 20, B = 10). Fig. 10. Power contours (A = 20, B = 5). 


2. Conditional power function of exact test. Under the alternative hypothesis it is easily 
verified that the conditional distribution of b, given r = a+, is 


(75) (o)™ 
Ol") = 27a 
ee 


where a= ((2 Ii P| 
1—p, 1—p, 


represents the probability ratio, or relative risk, and m, = max (0,r—A), my = max (r, B). 
The conditional power function of the exact test is then 


B(A|r) = P(b < by |H) = Sol” i 2 Loa (;) | 5 A ) (;) a. 


jam, \r—t) \t 





(3) 





or the ratio of two polynomials in A. The probability distribution (4) was first developed by 


Fisher (1935) in the determination of fiducial limits for the ratio A. 
25 Biom. 47 
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Occasionally there are situations involving the exact 2 x 2 test wherein the conditional 
power function A(A|r) is of interest. Thus in considering the interim status or effectiveness 
of two types of current therapy in which success or failure may be noted, those cases involving 
a fixed total number of failures (= r) may first be considered, and the respective failure 
rates then compared by the exact test for the 2 x 2 table. One of the present authors (P. H.) 
has computed values of (A|r) based on the Finney—Latscha tables: B < A, 5(5) 20 for 
A = 0-1(0-2)0-9 as programmed on the IBM-650 electronic computer. 

The ‘overall’ or average power of the exact test is 


B(A) = XAA|r) p(r) 


r be 
= qi gf = (2) >. CA_, CF 2°| R (5) 


where p(r) represents the convolution or distribution of r. The summation in r is over all 
significant pairs of points on the diagonals, r = a+, in the (a,b) sample space at level of 
significance equal to « at most, as determined from the Finney—Latscha tables. 

Patnaik (1948) developed normal approximations for f(A | r) and f(A). The general validity 
of the approximation to f(A |r) was subsequently questioned by Stevens (1951) who supplied 
a modification. Sillitto (1949) provided still another normal approximation to f(A), using 
the angular transformation for the binomial variates a and b. He computed the power of the 
normalized test for the difference in the two angles for a few selected values of A and B, 
though the approximation is not very precise for small A and B. 

The numerical evaluation of the double summation in (5) is rather involved generally. 
As a portion of a Master’s thesis requirement one of the authors (P.H.) programmed on the 
IBM-704 a series of tables of values of #(A). These tables give the computed values of £(A) 
from (5), or the probability of establishing a significant difference between two sample 
proportions in a 2 x 2 table for B < A, 5(5)20, using the 5 and 1 % levels of b, available from 
the Finney—Latscha results. 

The results on the power function calculations are summarized here in a diagrammatic 
representation (Figs. 1-10). Contours of equal power in the (p,,,) plane, prepared by 
graphical interpolation, are shown for the single-tailed test of the hypothesis: p, = p, against 
the alternative: p, > 2, for the various combinations of A and B and for the 5 and 1 % levels 
of significance. The contours for the 5 % level test are drawn below the diagonal and that of 
the 1 % level above the diagonal with the scales in p, and p, reversed. It is clear that when 
the value of B is much smaller than that of A, an unsymmetric series of contours results. 

As regards the accuracy of Sillitto’s approximation (1949), the following comparisons 
were made: 


Power function 
_-_ 





Sillitto 
A B Pr Pr a BO) approx. 
10 10 0-8 0-2 0-05 0-8054 0-891 
20 15 0-8 0-2 0-05 0-9681 0-983 


The authors would like to acknowledge the assistance of the Research Computer 
Laboratory of the University of Washington, and also certain financial support from the 
State of Washington, Initiative 171 Fund for Research in Biology and Medicine. 
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EDITORIAL NOTE 


The authors of the preceding paper have referred to the papers by Patnaik (1948) and Sillitto (1949) in 
which approximate methods were suggested for obtaining the overall power function of the tests for the 
significance of a difference between two binomial probabilities, p, and p.. In the two comparisons given 
at the end of their paper, it is seen that Sillitto’s approximation gives considerably higher power vaiues 
than those of the present paper. This tendency is also apparent for other values of A and B. For example, 
Sillitto (1949, p. 350) in his Table 2(a) gives some comparisons for the case A = B = 15. These are for 
the two-tailed test with a = 0-10 and 0-02, but as p, and p, draw apart, these results will scarcely differ 
from those for a single-tailed test with a = 0-05 and 0-01. 

By combining some entries from Sillitto’s Table 2 (a), from Patnaik’s Table 3(a) and from the original 
Bennett & Hsu calculations on which their power contours of Fig. 4 were based,* the following table 
can be made up: 


Power of tests. Case A = B = 15 








Nominal significance level Nominal significance level 
(a = 0-05) (a = 0-01) 
is sie = c » ‘ 
Patnaik Patnaik 
‘Exact’ 2nd Sillitto Bennett ‘Exact’ 2nd Sillitto Bennett 
Py Po values approx. approx. & Hsu values approx. approx. & Hsu 
03 O1 0-389 0-422 0-409 0-256 0-149 0-193 0-180 0-076 
6 ‘1 -919 953 926 "845 ‘739 "844 -778 -609 
“7 2 *896 “912 *893 -807 -680 -750 ‘713 *527 
8 2 “974 *982 -970 939 “872 923 *885 "765 


At first sight it seems anomalous that the ‘Exact values’ of Patnaik are all so much larger than the 
values of Bennett & Hsu. On examination of Patnaik’s paper, however, it seems clear that what he 
calculated was the sum of the products of the appropriate binomial probabilities associated with points 
in the (a, b) lattice falling beyond the significance levels obtained by assuming that the hypergeometric 
distributions of the null hypothesis could be represented by continuous normal distributions. Thus 
Patnaik’s power values were only ‘exact’ for the particular significance points resulting from this 
approximation. 

In the same way Sillitto’s approximation, using the angular transformation is based on assuming that 
the transformed variable is normally distributed. Bennett & Hsu have, however, used Finney’s (1948) 
significance points for ‘b given r’ and if Finney’s table is examined it is seen that the sum of the tail terms 
of the hypergeometric series are, owing to discontinuity, almost always considerably less than the 
nominal 0-05 and 0-01 values. The effective ‘size’ of the test based on Finney’s table is probably, there- 
fore, considerably less than that involved in the test using either approximation and, as a natural result, 
the power is less. 


* These results were attached to an earlier revision of their paper. 
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Whereas, however, we can make a shrewd guess at the ‘size’ of the test using Finney’s tables, it is 
impossible to be sure what the ‘size’ will be for the approximate tests. For samples larger than 20 the 
Finney—Latscha form of table is not of course at present available and, no doubt, as A and B increase 
both the size and power obtained from the approximations will approach their nominal values. 

An interesting point which the Bennett & Hsu charts bring out very clearly is how difficult it is to 
distinguish between two widely different probabilities in small samples. For example, even when 
A = B = 20, the odds are only just in favour of detecting a difference between a Pp, = 0O-5anda-p, = 0-2, 
using a nominal 5 % significance level (power = 0-53). E.S.P, 
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Table of the bounds of the probability integral when the first 
four moments are given 


By J. A. SIMPSON anp B. L. WELCH 
University of Leeds 


1. INTRODUCTION 


The calculation of upper and lower bounds for the probability integral, Pr(x < «), of 
a distribution whose first m moments, 0,, 62, ...,9,,, are given, is a problem for which a 
considerable general theory has long existed (for earlier references see, for instance, Uspen- 
sky, 1937). The present paper is concerned with the tabulation of the bounds when m = 4, 
and with the provision of some commentary on the tabular values. A main reason for 
undertaking this investigation is that we wished to provide some concrete figures which 
may be useful in teaching in connexion with the representation of frequency distributions 
by moments. Our tabulation shows what gains over the more elementary Tchebychef 
inequalities (cf. equation (4), below) are obtainable as soon as the skewness and kurtosis 
of a distribution are specified. A table of triple entry is necessary for the presentation of our 
results and accordingly, to cover the full range of the parameters involved, we have been 
forced to tabulate on a very broad net. (For a previous table on a finer net of values of «, 
but covering only a very limited range of all three parameters, see Berge (1932.) Other 
tables of varying extent must undoubtedly exist.) 

A brief summary of the formulae used in computing the table is provided, since direct 
calculation from these formulae will often be the best way of interpolating values not 
tabulated. In §4 some discussion is also given of another problem which may be made to 
depend on the one for which the tabulation is explicitly done. This arises when the range 
of x is limited, say to (b,, b,), but where now only the skewness of the distribution is known 
in addition to the first two moments. This will naturally include the case where one of the 
limits, b, or bo, is at infinity. 


2. VARIABLE UNRESTRICTED IN RANGE 


If all our information about the probability distribution function dP(z) lies in the values 
of the first four moments, it may be shown that the calculation of bounds for Pr (x < «) 
depends on the following preliminaries. 

Let us associate with the point x = « two further points x = p, and x = p, and define a 
3-point probability distribution consisting of probabilities c on «, d, on p, and d, on pg. 
Suppose that the five quantities p,, p2, c,d, and d, which we have introduced are then chosen 
so that the resulting 3-point probability distribution is equimomental with dP(x) as far 
as the fourth moment. If x (and a) are expressed in standard measure, so that 0, and 0, 
are equal to the usual measures of skewness and kurtosis ,//, and f., respectively, it may be 
shown that p, and pz are roots of the quadratic equation 

a?(a? — a, — 1) + {aA —0,(x? — a03—1)}+ {A — (a? — a0, — 1)} = 0, (1) 
where we write A =0,-@-1=£,-/,-1, 


an essentially positive quantity. 
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Furthermore, we find that 
¢ = (1+/1P2) (%—py)* (a —p), 
d, = (1+p_&) (py— fz) (pi1— 2), (2) 
d, = (1+p,&) (P2—&)~* (p2—p,)™*. 


The roots p, and p, are always real and the values c, d, and d, always positive which means 
that we have defined a real probability distribution which is a possible (although extreme) 
form which the actual dP(x) could take. The classical theory now asserts that this extreme 
distribution provides us with the bounds of Pr (x < «). The lower bound is given by summing 
those values of d; corresponding to the roots p; (either 0, 1 or 2in number) which fall below a. 
The upper bound is given by adding the value of c to this sum. If, for definiteness, we denote 
the least root by p, then, according to how « lies with respect to p, and p,, we find 


0<Pr(x<a)<e if a<A,, 
d,<Pr(~<a)<c+d, if A,<a<Ad,, (3) 
d,+d,< Pr(x<a)<1 if A, <«, 


where A, and A, are roots of the equation z?—0,x—1 = 0, i.e. 


Ay = H0,—V(8+4)}, As = {03+ J (63+ 4)}. 


The lower bounds in (3) are attainable to within as small a distance as we please. 


3. CoMMENTS ON TABLE 1 


The quantities c, d, and d, in (2) are functions of a, 0; and @, (or equivalently of a, 6, 
and A). A table of the solution (3) must therefore be of triple entry. In Table 1 we provide 
numerical values of the lower and upper bounds LZ and U when 


0, = 0(1)4,8; a =—10(1)—3,—2-5 (0-5) 2-5, 3(1) 10; 
and A = 0,055, 1, 2,3, 4, 6, 8, 12, 16, co; 


in all combinations. The values for given 0, are isolated in separate subtables. (Values for 
0, negative may be deduced by changing the sign of the variable at the outset and rephrasing 
the problem in an obvious way.) 

This mode of presentation brings into prominence the fact that in general, for given 0, 
and «, the range (L, U) corresponding to any A completely overlaps that for any smaller A. 
At one extreme when A = 0 we have (U—L) = 0 since in this case dP(x) must be con- 
centrated only on the two points A, and A, defined above, the probabilities associated with 
these points being A,(A, —A,)~! and A,(A, —A,)~", respectively. At the other extreme, when 
A + ©, one of the roots of (1) goes to infinity whilst the other is —a-1. Equations (2) then 
lead to a probability (1 + ?)-! associated with «, a probability a7(1+«?)-1 at —a—, together 
with an infinitesimal probability at an infinitely distant point. Hence, whatever 63, pro- 
vided only that it is finite, we have when A > oo: 


(4) 


(i) fora < 0 L=0, ld 
(ii) fora > 0 L=a%X(1l+a*), U=1. 





= 6 8b & 8 
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These bounds do not depend on @, at all and indeed are simply the Tchebychef bounds for 
the integral when only the first two moments of the distribution are given. Hence know- 
ledge of 6, does not narrow the bounds (L, U) unless it is accompanied by some restriction 
on A (or @,). When this further information is available then a pair of bounds will be obtained 
which are intermediate between those for A = 0 and A = oo. 

This behaviour of the solution is illustrated diagrammatically in Fig. 1, which relates to 
the case 0; = ,/f, = 1. The outer continuous curves here are the Tchebychef bounds of 
equation (4) which would be the same whatever 0,. The step function ABCDEF relates to 
the case A = 0 when the distribution dP(x) must be concentrated on the two points 


A, = }{0,—(03+4)} =-0-618 and A, = }{0,+,/(63+4)} = 1-618, 


so that for all values of « (excepting perhaps A, and A,) we have L = U. The dashed curves 
(together with AB and EF) are the lower and upper bounds when A = 0-5. For any A 
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Fig. 1. Upper and lower bounds for Pr(x < «) when 0, = ./f, = 1. (i) ABCDEF is the cumula- 
tive distribution function of x if A = 0. (ii) The dashed curves (completed by AB and EF) are 
the lower and upper bounds when A = 0-5. (iii) The outer curves are the bounds when A = oo. 


between 0-5 and oo the corresponding bounds will lie between the dashed and continuous 
curves. For any A between 0 and 0-5 the solution will lie between the step function and the 
dashed curves. 

The points A, and A, which are determined by 0, and which are roots of the orthogonal 
polynomial of degree two, associated with dP(x), obviously play an important part. For 
all values of A the curves coalesce at these points and hence for « in the vicinity of A, and 
A, knowledge of 6, and A is not enabling us in general to improve upon (4). As we depart 
from A, and A, either toward the middle or toward the tails of dP(x) we begin to obtain 
narrower bounds. The tails are, perhaps, of most interest. If, in Table 1, we concentrate 
attention, for given 03, on a given value of « below A, we see, from the values of U, how the 
maximum amount of probability in the tail below « falls to zero as A diminishes. On the 
other hand for given « exceeding A, the values of L also show how the maximum amount 
in the upper tail above « falls to zero as A diminishes. 
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The improvement in our inequalities is therefore seen to be appreciable although, as 
has often been pointed out, the fact that the extreme bounds are provided by a 3-point 
distribution implies that greatly improved inequalities can be obtained if further information 
about the form of dP(x) is available. (For a recent discussion of more restrictive problems 
the reader may be referred, for instance, to Mallows (1956).) Despite this, however, it is 
still of value, at least from a didactic point of view, to indicate numerically in a broad way, 
as is done in Table 1, just what are the gains which flow from the Tchebychef theory by 
using 4; and @, in addition to 6, and @,. We all encounter the common measures of skewness 
and kurtosis at an early stage in our study of statistical methods, and it seems to be im- 
portant to have exact information available over the whole range of the parameters con- 


cerned, showing how far these measures alone take us in the ‘representation of frequency 
distributions’. 


4. VARIABLE RESTRICTED IN RANGE 


Before proceeding to discuss the situation where the variable z is restricted to lie in a 
known range (b,,5,) it will be convenient to note certain conditions which must connect 
b, and b, with the moments. If we still assume that x is expressed in standard measure, 


these are 
(1+6,6,) < 0, (5) 


(b,— by?) < 83 < (b,—bz), (6) 


— (0,9 —1) (6$—=0.05—1) 


_ — @2— 3 : 
0 <A =(0,-63-1) < r+5,6,) 





(7) 


The proof of these statements follows from the consideration that, whatever 6, the 
quantities 


{ (—b,) (by—2) dP(a), | (w—b,) (e—8)*dP(2), 


[o. —2x)(~—d)?dP(x) and |e —b,) (bg — x) (w— 8)? d P(x) 


are essentially positive. We shall have occasion to use (7) below. 

The solution of the problem of evaluating the extreme bounds of Pr (x < «) when 6, b, 
and moments up to @, are given will obviously still be given by the analysis of § 2 for those 
values of « which are such that the roots (p,, 2) of equation (1) turn out to lie within (b,, b.). 
However, for certain values of « the roots (/,, 2) will not be so contained and other formulae 
are needed. The whole solution is conveniently set out in a form suitable for computation 
by Zelen (1954) and we shall not say anything further about it here beyond noting that 
Table 1 is now no longer universally applicable. Instead, we shall turn to a somewhat 
simpler limited range problem which is of interest in the present context in that, whatever a, 
its solution can always be linked up with Table 1. This is the problem where, in addition to 
b, and b,, only the moments up to @, are given (and not 9,). The calculation of bounds for 
Pr (x < «) is in this case seen to depend on the following preliminaries. 

Let b be one of the ends of the range of x (which end to be specified later). Let us associate 
with the points « and b a third point x = p and define a 3-point probability distribution 
cona,donpandeonb. Suppose that the four quantities p, c, d and e are chosen so that the 
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resulting 3-point distribution is equimomental with dP(zx) as far as the third moment. This 
requires that 


p = (0,—%—b)(1+.ab)>, (8) 
¢ = (1+bp) (ab) (a—p)>, 
d = (1+ba)(p—a)4(p—b), (9) 


e = (1+pa)(b—p)* (b—a). 


So far we have not said whether b = b, or b = by. The choice will now be made so that, 
simultaneously, we find b, < p < b, and also c, d and e all positive. For any particular « it 
transpires that this condition will in general be satisfied by setting b equal to one and one 
only of the alternative values 5, or b,. We have thus defined in a unique fashion, through 
(8) and (9), a 3-point distribution on («,b,) which is a possible form which dP(x) could 
actually have. It is now a known result that this extreme form provides us with the bounds 
of Pr(x < «). The procedure is to observe how many of the two quantities b and p are less 
than a. The sum of the corresponding weights will give the lower bound of Pr (x < a). The 
upper bound is obtained by adding c on to this sum (for more explicit details cf. Zelen 
(1954)). 

Direct calculation in this way from (8) and (9) is straightforward, but alternatively we 
may make a link with Table 1 in the following way. For the 3-point distribution (c,d, e) 
on (a, p, 6) the fourth moment, 64, say, can be evaluated and leads to 


A’ = (0,-—63-—1) = —(1+ba) (1+bp) (1+ap) 
= —(b®—6,b—1) (a2 —0,a—1)(1+0b)-2. (10) 


If we substitute 6 = 6, and 6b = b, in (10) it can be shown that only one of the resulting 
A’ lies between 0 and —(b?—6,b,—1) (b2—0,6,—1)(1+6,6,)-1. This value of A’ must 
correspond to that choice of 6 which leads through (8) and (9) to a real 3-point probability 
distribution comprised in (5,,6,). For, as we noted in (7) above, any distribution lying in 
(b,,6,) must have its moments related to 6, and 6, in just this way. It follows then that 
since Table 1 was based on a 3-point distribution we can also use it to solve our present 
problem provided we enter it in an appropriate fashion. We may therefore summarize the 
derivation of the bounds of Pr (x < «), when 6, (= ./f,) and the range (6,, b,) of x are given, 
in the following way: 

(i) Calculate both 


_ (b§—b, 43 — 1) (a — a8, —1) 
1+ab, 





Ss . a 2 et 
a 4. Shee 


= 1+ab, 


(11) 


(ii) Observe which of these quantities lies between 0 and 
— (bj — 6,3 — 1) (63 — 6,03 — 1) (1+ 6,53). 


(iii) Adopt this as a value of A to enter Table 1. 
Whether any gain, apart from some insight into the solution, is obtained from this 
method of approach depends on whether we are led to a part of Table 1 where interpolation 
with respect to A is easy. (In this connexion it should be noted that interpolation between 
A = 0 and 0-5 and in certain places between A = 16 and © is not to be recommended.) 
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If the range is limited at one end only, so that z is contained either in (a, 00) or (—00, a), 
say, the steps (i)—(iii) become 

ee aE gee 
(i) Calculate A’ = — aa a! la ; 
1+aa 

(ii) If A’ is positive, enter Table 1 with A = A’. 

(iii) If A’ is negative adopt the Tchebychef solution based on two moments (which is 
the same as entering Table 1 with A = 00; cf. equation (4), above). 





We wish to acknowledge some helpful suggestions from the referees relating to the way 
in which the tables are presented. 
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Normal approximation to the chi-square and non-central 
F probability functions 


By NORMAN C. SEVERO anp MARVIN ZELEN* 
University of Buffalo and National Bureau of Standards 


1, INTRODUCTION 


Although extensive tabulations of many probability functions are now available, there 
continues to be interest in developing easier and more accurate approximation formulae. 
These approximations are especially useful to the occasional computer who does not have 
ready access to extensive tables. In this paper we present normal approximations to the 
x? and non-central F probability functions. The x? approximation is an improved Wilson— 
Hilferty normalized deviate. The non-central F approximation employs a cube-root trans- 
formation and a ‘Geary type’ solution. 


2. THE x? APPROXIMATION 
The x? probability function with v degrees of freedom is defined by 


Pot) = BHT Gey [treat 


for 0 < x? < co. Two well-known approximations to this probability function are due to 
R. A. Fisher and to E. B. Wilson and M. M. Hilferty (see Merrington, 1941). Fisher’s approxi- 
mation takes ,/(2x*) to be normally distributed about ,/(2v — 1) with unit standard deviation. 
The Wilson—-Hilferty approximation is based on the fact that (x?/v)! is approximately 
normally distributed with mean 1 — 2/(9v) and standard deviation ,/{2/(9v)}. 

Let the standardized normal probability function be denoted by P(x); i.e. 





Pa) = |" 1 o-te dt, 


v (27) 
Then these two well-known approximations to the 100p percentage point of the y?-distribu- 
tion may be written x3(v) = i{z,+J(2v—1)}* (Fisher) (1) 
D) 2\8 
2 < as el i —Hi 
and x2(v) = vf +, 5 (Wilson—Hilferty), (2) 
where , is such that P(x,) = 1—p. (3) 


Merrington (1941) presented a numerical comparison of approximations (1) and (2) with the 
exact values for v > 30 (cf. Table 8 of Pearson & Hartley, 1954). We have reproduced 
Merrington’s comparison table in our Table 1, which also includes the values obtained by 
the new approximation given below. 
Let the probability function for 
x _ et - 2/9») 
(2/9v)} 





(4) 


* Now at the University of Maryland. 
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Chi-square and non-central F probability functions 
be denoted by P,(x|v). Then using the terms of the Gram-—Charlier A series to O(v-#) 


PO) y_ Pc) 
a + ; 


P(e|v) = P(e) -2— ii (5) 





where P\™(zx) is the nth derivative of P(x) and y, and y, are the measures of skewness and 
excess for X. These moments are given approximately by (Abde!-Aty, 1954) 


23 4 


Y1 = 358° cake =, (6) 


Consider the approximation to the normal probability function P(x+h) as given by the 
first two terms of the Taylor expansion about z; i.e. 

P(x+h) = P(x)+hP(z). (7) 
Our new approximation involves finding that value of h, say h,(x), which for given 2 and 
v gives P,(x|v) = P(x+h,(x)). This is found approximately by equating the right-hand sides 
of (5) and (7). In this way we obtain 








a... Yr POX) | Y2P*(x) 
h(a) = PIS | a, a 
_ 2 f28(a®—1) (28-32) 

7 3,/v 4 f 
We shall drop the argument 2 and write simply h, for h,(x). Thus our approximation to the 
probability function of x? becomes 





(8) 


P(x?|v) = P(x+h,), (9) 
where x and h, are given by (4) and (8), respectively. For the 100p percentage point we 
obtain the approximation 2 2)3 

Xp(?) = »{1-= + (e,—m) [5 , (10) 

where x, is given by (3) and h, is the value of (8) at the point x = z,. 
A good approximation to equation (8) in the neighbourhood of v = v, may be obtained 

by noticing that ‘ 
A, = yh, +R, (11) 
Biat-1)f 1 1 

paitcd = —_-_— ee eee aoe 12 
where R 3% Fa aa (12) 





Therefore in the neighbourhood of v, = 60 we may use 


60 , 
h, = > hoo (13) 
where Ago is given in Table 2. 


Table 2. Factors for use in equation (13) 


x Neo x heo x heo 
—3-5 —0-0118 —1-0 0-0006 1-5 — 0-0005 
—3-0 — 0067 —0:5 -0006 2-0 -0002 
— 2-5 — 0033 0-0 -0002 2-5 -0017 
— 2-0 — :0010 0-5 — :0003 3-0 -0043 


-0001 1-0 — -0006 3°5 -0082 
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Equation (13) with linear interpolation in Table 2 was used to obtain the new approxi 
maticn values for the percentage points in Table 1. Notice that R = 0 whenever v = pv, or 
x = +180 that in Table 1 we would expect the best results when v = 60 or x = +1. 

In Table 3 we show some comparisons for selected small values of v. The (b) values in 
this table were obtained by using the approximation 





































9 
h, = = hyo; (14) 
v 
where the appropriate h., values were linearly interpolated from Table 4. 


Table 3. Comparative table of percentage points of x? for small values of v 


P 

Dee 0-995 0-950 0-750 0-500 0-250 0-050 0-005 
v 

5 (a) 0-412 1-145 2-675 4-351 6-626 11-070 16-750 
(b) 0-381 1-134 2-675 4-354 6-631 11-076 16-700 
10 (a) 2-156 3-940 6-737 9-342 12-549 18-307 25-188 
(b) 2-136 3-937 6-738 9-342 12-550 18-313 25-178 
20 (a) 7-434 10-851 15-452 19-337 23-828 31-410 39-997 
(b) 7-427 10-852 15-452 19-336 23-827 31-415 40-002 


(a) Exact values. (b) New approximation, equation (14). 


Table 4. Factors for use in equation (14) 


x hoo x hoo x hoo 
—3°5 — 0-03876 —1-0 0-00185 1-5 — 000202 
—3-0 — :02291 —0°5 -00186 2-0 — -00049 
—2°5 — -01162 0-0 -00078 2-5 -00342 
—2-0 — -00419 0-5 — -00069 3-0 -01042 
—1+5 -00007 1-0 — -00185 3°5 -02119 


3. THE NON-CENTRAL J’ APPROXIMATION 
The non-centra] F statistic is defined by 


patty 


Xa/ Yo” 
where y;” follows a non-central chi-square distribution with degrees of freedom v, and non- 
centrality parameter A; y3 follows a central chi-square distribution with degrees of freedom 
v2; and x? and 4% are statistically independent. Patnaik (1949) has obtained an approxi- 
mation to the non-central F distribution by fitting an F-distribution with the exact first 
two moments. In Table 5 we reproduce Patnaik’s comparative table that showed values 
obtained by use of his approximation and exact values computed by Tang. We have also 
included in Table 5 values obtained by the approximation developed below (equation (17)). 
Patnaik pointed out that two-way interpolation (linear in one direction and four-point 
Lagrangian in the other) in the Tables of the Incomplete Beta-Function (K. Pearson, 1934) 
was necessary in order to obtain his approximate values. The values computed by our 
method involved only linear interpolation in the Normal tables. 






























in 


4) 





Denote the probability integral of F’ by P(F’|v,,v2,A). Let 


Table 5. Approximate and exact values of the F'-probability function, P(F’|v,, V2, A) 


Vy 


where L = cY;—(F’)*Y,. The mean and variance of Yj are given approximately by Abdel- 


Aty (1954), as 


respectively. Because the distributions of Y; and Y, are each approximately normal, it 


3 
Fi=LG/+0K, Y= baad, = (24) 


Then the probability integral of F’ becomes 


Ve 
10 


20 


10 


20 


10 


30 


P(F’|v4, Vg, A) = Pr| 


A 


2 


9 


F 


3-708 
6-552 
3-708 
6-552 


3-098 
4-938 
3-098 
4-938 


3-326 
5-636 
3-326 
5-636 


2-711 
4-103 
2-711 
4-103 


3-072 
5-057 
3-072 
5-057 
2-266 
3-173 
2-266 
3-173 


cea 





12 
x [vy < ’ 
X3/Po 


Patnaik 
approximation 


0-752 


2 


9 


| 


feat 
(vy, +A)? 


Chi-square and non-central F probability functions 


P| = Pr < 0}, 


Exact 


> 


New 
approximation 


0-750 
-919 
+202 
-520 


0-707 
“889 
119 
+349 


0-734 
914 
*155 
-463 


0-669 
871 
-064 
+244 


0-716 
-909 
“117 
-409 


0-581 
*815 
“014 
*085 


follows that L is approximately normal with mean and variance given by 


and 


respectively. Therefore 


=e 


2 _ 2c%(v,+2A) 


oT = 


9 


“9(v, +A)? 





2c vy +2A 
(vy, +A? 


2(F’)é 


IV, 


> 


Pr{L < 0} = P(—p;/¢1) 


|-@eh-= 


mr 


(15) 
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and so the normal approximation to the non-central F distribution becomes 
P(F’|v,, V2,A) = P(2), (16) 


(rsa) ('~ a) -P “apa 


where t= [20 +2), 2 (4F } 
9(v, +A)? vg \v, +A 











(17) 








Equation (16) was used to compute the ‘new approximation’ values given in Table 5. 

Note that when A = 0, the above approximation reduces to the approximation for the 
(central) F distribution given by Paulson (1942). We also point out that approximation (17) 
produced much more accurate results than either of Johnson’s approximations (cf. Johnson, 
1959). The latter are based on normal approximations to the difference between a negative 
binomial variable and an independent Poisson variable; this difference Johnson shows is 
related to the non-central F variable. 


We would like to thank Miss Shirely Young, D. Liepmann, and Mrs Marion T. Carson for 
performing the extensive calculations, 


REFERENCES 


ABDEL-Aty, 8. H. (1954). Approximate formulae for the percentage points and the probability in- 
tegral of the non-central xy? distribution. Biometrika, 41, 538-42. 

CAMPBELL, G. A. (1923). Probability curves showing Poisson’s exponential summation. Bell Syst. 
Tech. J. 2, 95-113. 

Jounson, N. L. (1959). On an extension of the connection between Poisson and x? distributions. 
Biometrika, 46, 352-63. 

MERRINGTON, M. (1941). Numerical approximations to the percentage points of the y* distribution. 
Biometrika, 32, 200-2. 

PaTtNaAIK, P. B. (1949). The non-central y?- and F-distributions and their applications. Biometrika, 
36, 203-32. 

Pautson, E. (1942). An approximate normalization of the analysis of variance distribution. Ann. 
Math. Statist. 13, 233-5. 

Pearson, E. 8. & Hartiey, H. O. (1954). Biometrika Tables for Statisticians, 1. Cambridge Univer- 
sity Press. 


[Editorial Note. An alternative method of approximation to the distribution of non- 
central F is given by Barton, David & O’Neill in the paper which follows. On pp. 430-1 
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Some properties of the distribution of the logarithm 
of non-central F 


By D. E. BARTON, F. N. DAVID} anp ANNE F. O’NEILL 
University College, London and Wheaton College, Norton, U.S.A. 


1. IntTRODUCTION 


Given two independent variables, y’? distributed as a non-central chi-square with degrees 
of freedom f, and non-central parameter A, and y? distributed as a central chi-square with 
degrees of freedom f,, then we define non-central F as 

r= (22), 
xfs 
The distribution function of F* is 
= 5 [POY BAt+h)+5-0! (2)" 7 abhi ( fi ~— 
pt) = FE apse naam (g) | P(e | 
This distribution was first given by Fisher (1928). In a different functional form, i.e. 

fiF* 
fo+fiF* 
it was studied by Wishart (1932) and by Tang (1938) who gave a few values of the probability 
integral. Patnaik (1949) approximated to the distribution of F* by a central F distribution. 
It is clear that any tabulation of the distribution of F* will be a formidable proceeding. 
There are three parameters f,, f. and A which intervene explicitly. If we are concerned with 
the power function of the F-test there must also be the values of the central F at which 
p(F*) will need to be evaluated. We discuss here the log-transformation of F* and the possi- 
bility of a normal distribution as an approximating function to the transformed variable. § 


Be = 


2. THE CUMULANTS OF log F* 

The distributions of F and F'* are extremely skew and it does not appear profitable to 

consider them directly. Fisher & Cornish (1937) showed that expansions using 
z=tlogF 
could be obtained which gave accurate arithmetical results for the probability integral 
of z (and therefore of F'). Accordingly we look at 
z* = flog F*, 

and consider the case first when A, f, and f, are small. Since the distribution of z is not very 
different from normal and can be expressed as a series of Hermite polynomials weighted by 
the standardized cumulants of z, it is reasonable to suppose that for A small the same will 
be true of the distribution of z*. Wishart (1947) gave expansions for the moments of z but 
these forms of expansion are not convenient for our purpose. We have that 


22* = log (fo/f1) + log (x’*) — log (x”). 


+ With the partial support of the office of Naval Research while at the University of California, 
Berkeley. 

§ Some comparisons of this approximation with that suggested by Severo & Zelen in the 
preceding paper are made in an Editorial Note on pp. 430-1 below. 
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For ease of writing let a,=tf,, O0= ht. 


The characteristic function of log (4y’*) may be written as 





— 9 (YA (Mat) 
Gl) = & rl ar( T'(a,) ), (1) 
r(l(at9\_ rire E(t 5 +49) 
where A (ARE j= 30-0 i7C, Ta, a (2) 


By manipulation of the factorial expressions under the right-hand sum it may be shown that 
this equation reduces to 





(Pat “)) _ Pla, +9) 
a (Naa) Pa) oF " 
where 6 = 0(9—1)...(0—r+1) 
and al] = a,(a,+1)...(a,+r—1). 


Consequently the characteristic function of log (}’2) may be written as 


_ T(a,+9) & (a\r1 
a(t) = “2 & (5) nave 


r=0 


(4) 


while the value for the central log (4+?) is 


boll) = Tay (5) 


We follow the notation of Legendre and Gauss (cf. H. T. Davis’s (1933-5) Tables) and 
write d d 
W(x) = Flog T(x), w(x) =F v(x) 


and so on. Taking the logarithm of the characteristic function, differentiating with respect 
to @, and then equating @ to zero as many cumulants can be obtained as desired. Let 
K,,(A) denote the rth cumulant of log (4’*) and x,,. the rth cumulant of log (4x7). Then 

Ky,(A) = ¥(a,)+M, 

Ka(A) = y'(a,) + M, — Mj, 

K3(A) = y"(a,) + M, — 3M, Mj + 2M}, 

Ka (A) = "(a,) + (Mi, — 4M, UM, + 6M, — 3M) — 3{M, — M3}*, 

= (gay (-1)-* 

where M, = wz a |S?|. (7) 


|S?| is Stirling’s number of the first kind in modulust and, conventionally, |S1| is (r—1)! 
It will be noticed that we may write 
0M, 
Plt) = Pot) = 
s J 
so that formally log (4?) is the sum of two independent random variables, log ($y?) plus 
a ‘random variable’ with crude moments M;. The quantities containing the J/’s in the 


(8) 


ft These will be given in Barton, David & Kendall’s Symmetric Function and Allied Tables at present 
in preparation for publication. 





age 


— 





(4) 


(5) 


nd 


ect 
uet 


(6) 
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expression for x,,(A) are the cumulant functions of the ‘moments’ M;. If we denote these 


by &, we have 
Ky(22*) = (a) — W(ae) + log (ag/a,) + 8, 


K(22*) = y’(a,) + W' (da) + Re, 
K,(2z*) = w"(a,)—p" (aa) + Rs, 
Kq(22*) = Ww" (ay) + Wr" (Gq) + Ry, 


(9) 


where a, = $f,, a2 = $f. As many more cumulants may be written down as desired. (a), 
y'(a), w"(a), wr" (a), and &,, Ry, Kz, Ry are given in Tables A and B, respectively, printed on 
pp. 425-29. . 

A simple recurrence relation may be found for these M’s. Let 


© /A\r1 0 _ 6iM, 
a= 3 (5) rial 4 jl’ 





(0+1)G,,= & (5) aol (+1) 0%) 


<0 \2) rial" 


2a,— =e 
= Ga, + os = a [Ga,-2 4 Gaal + (a, ai. [Ga,-1 ink G1) 


_ 2(a,—1) (4-2) 


so that 0G, x 





[G,.-2 a G1] + (a, rr 1) [Ga-1 a G,,]. (10) 
Thus 


rM,_s(a,+ 2) = —_ +1) 


(M,(a,) — M,(a, + 1)) + (a, + 1) (Ma, + 1) — M(a, + 2)). 


This relation may be used to build up tables of M, for higher values of a,, in terms of M,_, 
and initial values of M,. The series for V/, are rapidly convergent even for A = 10 and /, = 20, 
while for A = 1 and f, = 2, (a, = 1), only three terms are required for seven decimal place 
accuracy. 

It is clear that the series (7) given above will be useful for most practical purposes and 
it is this which we have used for tabulation. For very large A the calculations may be 
lengthy and for this case we would propose an alternative expansion. We have 


log x? + log (x? —(fi+A) +f +A) 


1 


~ Joo (Fel fat) x? —-(fitA) 
=a 2) ero oH), 


The moments of log ($y) are known exactly and are as given above (i.e. they are the leading 
terms in (6)). For brevity write 


= x? —(fi tA) 
H = log(1+ zit"). (11) 


We expand the right-hand side and using the fact that the rth cumulant of x’? is 


2-17 — 1)! (f, +r) 
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 L AtA GaP 3(f, +A (Ata (Atal LAA (Atay 
Pr ene ee ee 4a a |: 4, 4A, 25628 |+ | 
. [Ata (fi +A? (fi:t+Ay (fi+A® (AFA 138A +A)® (Atay 3(At+Aysl 
Pre ee wee. }+[- Me Oe pl 
Lf AP (Ata (f+) (ita (fit A (Atay (Atay ” 

x (H) =| 16 + 48A 4. = taal t 
UAE AR Atay (At aye (Atay 
(12 
Because of the independence of x? and y’? we have 
Ky(22*) = log (fo(fi +A)/fi) — Kia + (4), 
k(22*) = K,(H)+(—1) ke (r > 2). ; 
@ 
fe 


3. EVALUATION OF THE POWER FUNCTION OF THE F-TEST 


Fisher & Cornish (1937) showed that an Edgeworth expansion was suitable for calculating 
the probability integral of z provided the degrees of freedom of numerator and denominator 
are large. Following a procedure indicated by David (1959), we shall use an Edgeworth 
expansion and the moments of 2z* to evaluate the power function. Our procedure will 
depend not directly on the degrees of freedom of numerator and denominator but on the 
relative values of the moments of central 2z and on the corrective term to be addedin order ‘= 
to obtain the moments of 22*. Write 


K,(2z)—m =ol,, «,(22*)-m =o, 


K,(2z)—o? = o°l,, K,(2z2*)—o? = o* Ly, (13) ‘ 
k,(2z) = o*l,, K,(2z*) = o*L,. t 
m and o? are at choice and we will choose them so that 1, and /, are zero. If 


22—K,(2z) 22—m 


V{k,(22)} og 
and (x) = a 
be g — 4/(27) } 
2z—m Za 
then P = < =| = | g(x) da + 9(x,)[— hl, A, — kl, Hy — 3513 H)]+... 
= l-a, (14) 


where H, stands for the rth Hermite polynomial evaluated at the point 7,. Again ) 
zx 
P{2z* < ox, +m} = | g(x) da 


+9(%)((—L, — L5H) — (SLi A, + $0, H, + §L, L5H, + tly Hy+pgL5Hs)—...) (15) 


14) 


5) 





(12 
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so that the amount by which P{z < z,} is exceeded in the z* distribution is approximately 


oe) [ CPD) _ yp, el _ yp, (22) — (2) 





Ox: 7 a 
_ 1H, (Se2e) se) _ LH, ee) eae — 
—i,H, (nt) — +H, wr: jer 
—J;H. a _ 1H, {% to a wn 


Further terms depending on the higher cumulants can be added if required. This expansion 
clearly depends on known values of z,. These have been given directly by Fisher & Yates 
(1953, Table V) for four values of a. Since z, = }log F,, values for further levels can be 
found from Merrington & Thompson’s tables (1943). If the power of the F-test is required 
using a significance level of z or F which has not been tabulated, it will be necessary either 
to interpolate between known percentage points or to use the inverse Edgeworth expansion 
to determine such points. Thus if £ is the solution of the equation 


then the central z, can be determined from, 
2 == Ky(2) + 0fE + ly Hal) + dela Hy(2) — dgl2(2HQ(E) + £)+ -.-}, 


where the /’s retain their previous sense and H,(£) is the rth Hermite polynomial evaluated 
at £. Fisher & Cornish gave a table of these Hermites for some values of «. Once z, is found 
the previous expansion may be used. 

Under certain conditions, for example, when the distribution of z* is far from that of z, 
the series given by (16) will not converge fast enough to be useful. It is also possible that 
it may be desired to tabulate the distribution of z* without reference to the percentage 
points of z. In such cases the Edgeworth expansion may be used directly with the standard- 
ized cumulants of 2* or 2z*. If 


K,(2z2*) —m* = Y,0*, x,(22*)—o*? = 0%, x,(22*) =o" PL, (17) 


and we choose m* and o*? equal to x,(22*) and x,(22*), respectively, so that 7, and #, are 
zero, then 


x 
Piet < Z} = | g(w) da: + g(X) { — $Hy(X) Ly — dy Hy(X) Ly— AgHe(X) L3+...}, 


4 2Z — k,(2z*) 
" (Ka(22*))3 


The inverse of the expansions follow directly. Let £ be the unit normal deviate defined by 


where X= (18) 


g 
| g(x) dx = 1—a. 
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Then Y*—§ = §L4(6? — 1) + aig L4(S° — 36) — gfe L5(25?— 56) +..., 
where /, is as defined in (17) and m* and o*? are equal to «,(2z*) and x,(2z*) as before. The 
value of 2z* which cuts the distribution into the proportions 1—a@:« will be 
Y* /{kq(2z*)} + «y(22*). 


An alternative expansion in terms of the central distribution of 2z is also possible, using the 
standardized I, and L,. If Y be the value of 2z which divides the distribution of central 2z 


in the ratio 1—a:a then the value of Y* which divides the non-central distribution in this 
ratio is 


ye—¥ = 4914 e184 gees aier—3ey Ss gy(aer— 06) (23) (2423) +... 
where o = J {k,(2z)}. 


This gives a standardized deviation which must be multiplied by 7. This second procedure 
will be useful for small values of the non-central parameter when the differences between 
the central and the non-central distributions are not large. 


4. MOMENTAL RATIOS FOR THE DISTRIBUTION OF z* 


The distribution of z* is not too far from the normal, the largest discrepancies occurring 
when A is large and f, = 2a,, the degrees of freedom of the numerator, and f, = 2a,, the degrees 
of freedom of the denominator, are very different. For interest we give in Table 1 below a 
few selected values. 


Table 1. Momental ratios, ,/8, and B,—3 of z* = 4 log F* for selected values of f;, fo and A 





VA, j,-3 
fe Sa 
i A ™~ "ed A ‘ 

A A 2 4 10 20 2 4 10 20 
0 2 0 —0-5772 —0-9238 —1-0336 1-2 1:3327 1-8707 2°1210 
4 00014 — -5850 — -9406 —1-0540 1-2192 1-3634 1-9239 2-1855 
1 0088 — -5977 — -9741 —1-0958 1-2647 1-4357 2-0526 2-3430 
3 1165 — +5835 -—1-0787 —1-2533 1-4884 1-7686 2-7550 3°2616 
0 4 0-5772 0 —0-4407 —0-6050 1-3327 0-5938 0-6868 0-8820 
5 +5790 0:0004 — +4436 — -6098 1-3380 -5980 -6940 +8928 
1 +5845 0025 — -4490 — -6198 1-3517 -6084 -7118 -9195 
5 -6901 0985 — -4223 — -6453 1-5420 *7025 +8343 1-1501 
0 10 0-9238 0-4407 0 — 0-2023 1-8707 0-6868 0-2187 0-2228 
4 *9241 -4410 0:0000 — -2026 1-8714 *6874 *2191 +2233 
1 *9249 -4419 0003 — -2033 1-8736 6891 +2202 +2248 
0 20 1-0336 0-6050 0-2023 0 2-1210 0-8820 0-2228 0-1049 
4 1-0337 -6051 +2024 0-0000 2-1211 *8821 +2229 +1049 
1 1-0338 -6053 +2025 -0000 2°-1215 +8825 +2230 *1050 


5. NUMERICAL EXAMINATION OF THE APPROXIMATIONS 


Tang (1938) computed some exact values of the probability distribution function of F'*, 
or rather of the related Z*. These did not prove altogether suitable for our present purposes 
which were to test our approximate series for small values of A. Exact values of the pro- 
bability integral of F* over the range which we required were therefore computed de novo 
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Table 2. Comparison of approximations to P{z* < z,} 
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A=}, f,=f2 = 10, £, = 0-0000, 2, = 3-2191 A =3, f, = 10, f, = 20, 2, = 0-0410, £, = 3-2233 
‘ Error in approximations i é Error in approximations 
Exact c a ‘ Exact ¢ oe ee 
value Normal Series I Series II value Normal Series I Series IIT 
0-9988 0-0005 0-0000 0-0000 0-9987 —0-0009 — 0-0002 — 0-0002 
+9940 ll 1 -1 *9935 — 25 — 5 2 
*9881 12 0 —2 -9873 — 38 -— 5 4 
+9708 5 —2 —2 *9692 —57 -— 8 5 
9423 - 8 -—3 1 +9398 — 65 - 1 6 
-8868 —3l —5 2 +8830 — 53 33 3 
*7258 —45 1 2 +7205 +35 12 —2 
+4699 z 7 -1 4652 133 6 —5 
+2268 47 1 -—3 +2243 81 —10 —6 
0878 22 —5 —2 -0869 —24 — 6 1 
0431 1 —+ 0 -0426 —51 1 6 
*0212 —- 9 -1 2 -0210 —51 4 6 
-0084 —12 0 1 0083 —35 4 3 
0041 - 9 1 1 0041 —23 4 1 
-0008 -— 4 1 0 “0008 — 6 1 —1 
A=L, fi, =f, = 10, £, = 0-0000, 2, = 32202 A=1, f, = 10, f, = 20, 2, = 0-0413, 2, = 3-2248 
: Error in approximations Error in approximations : 
(approx. — true) (approx. — true) 
Exact r ~ ~ Exact r A is 
value Normal Series I Series II value Normal Series I Series II 
0-9986 0-0005 0-0001 —0-0001 0-9983 —0-0011 0-0004 —0-0001 
9929 ll 1 —2 -9918 —29 —10 1 
-9861 ll -1 —2 -9843 —43 - 9 4 
*9662 3 4 -1 *9627 —61 —14 6 
*9342 —12 -7 1 +9288 — 65 0 5 
+8730 —35 -8 3 +8658 —52 7 -4 
‘7015 —43 3 3 -6910 51 24 —3 
4411 14 13 -1 +4321 136 9 —8 
*2056 46 0 —4 -2009 67 --19 —5 
0770 18 —8 -1 *0754 —32 —10 2 
0371 — 2 —6 1 0364 — 54 2 5 
0180 -—1l —2 2 0177 —49 8 5 
-0070 —12 0 1 -0069 —32 8 4 
0034 - 9 2 1 0034 —20 7 0 
0007 — 4 1 -1 +0007 — 6 2 —2 


Error in approximations (approx. — true) 





Error in approximations (approx. — true) 

















Exact es Series Series Series . Exact Series Series Series : 
value Normal I II III S, value Normal I II Ill S, 
A=3,a=001 A=3,a=0-05 
0-975 0-007 —0-001 —0-004 —0-003 0-000 0-881 —0-015 0-016 0-010 0-006 0-000 
oi +16 4-19 +11 +1 : a wae ~3 s wu a" 
920 —37 —28 10 16 : —_— «2 . ux - -3 
895 —38  —22 3 16 0 -718 12 = =e 2 aa 
A=5,a=0-01 A=5,a=0-05 
0-978 0-012 0-005 —0:006 0-001 0-000 0-892 —0-004 —0-013 0-004 0-002 —0-001 
-960 3 0 0 0 0 +833 —12 «a 4 2 0 
a a 4 2 1 +738 0 -: = 3 0 
te ee | 5 4 1 -681 15 48 -2 3 0 
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from Tang’s formulae.} For the smaller values of A, three approximations for P{z* < z,} 
are compared in the upper half of Table 2, using values of ‘central’ z, taken from the two 
tables referred to above: 

(i) the crude normal approximation, obtained by assuming that {z* — x,(z*)}/,/Ks (z*) 
is a unit normal deviate; 

(ii) Series I approximation from equation (16); 

(iii) Series II approximation from equation (18). 

The upper half of the table gives the differences, in units of the fourth decimal place, 
between the approximate and true value. It will be seen that the crude normal approxima- 
tion is in some cases surprisingly reasonable. 

Some calculations were carried out to see what happened for larger A and for f, and f, 
either small or widely different. The results are shown in the lower half of the table. In these 
cases Series I is improved by adding further terms of the Hermite expansion to equation 
(16); we have termed this Series III. It was also found that using the correct first four 
moments of z* and the functional form called S,, by Johnson (1949), the probability integral 
of z* could be very closely reproduced, at any rate for the points with a = 0-05 and 0-01. 
The labour of fitting an S,, curve lies in finding its parameters, given the moments; this labour 
is compensated to some extent by the fact that once fitted, an approximation can be found 
quickly for the whole of the probability integral of z*. But the procedure was thought 
to be too lengthy to warrant its being put to general use and we therefore abzndoned it. 

The Table B for calculating the moments of z* has been computed for A = 0-0 (0-5) 4, 5. 
It is assumed that for intermediate values of A either the series expansion will be used to 
calculate the M’s, and therefore the §’s, or that there will be interpolation into the existing 
tables. In order to examine this latter point, the values of %,, ®,, KR, and &, for A = 1-625, 
f; = 4 were obtained from the series for M and also by 4-point Lagrangian interpolation, 
with the following results: 


RK, RK, Ks RK, 
From series 0-35788 — 0:03749 0-01211 — 0:00635 
By interpolation *35787 — :03743 01203 — :00627 


The accuracy obtained by interpolation is here clearly adequate for the application of 
equations (16) or (17). 
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+ A as used by us is one half of the A used in Tang. 
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a=4f 


¥(a) 


— 0-5772 1566 
+ 0-0364 8997 


0-4227 8434 


0-7031 5664 
0-9227 8434 
1-1031 5664 
1-2561 1767 
1-3888 7093 


1-5061 1767 
1-6110 9315 
1-7061 1767 
1-7929 1133 
1-8727 8434 


1-9467 5748 
2-0156 4148 
2-0800 9082 
2-1406 4148 
2-1977 3788 


2-2517 5259 
2-3030 0103 
2-3517 5259 
2-3982 3913 
2-4426 6168 


2-4851 9565 
2-5259 9501 
2-5651 9565 
2-6029 1809 
2-6392 6973 


2-6743 4666 
2-7082 3524 


Note. 


¥(a) 
1-6449 3407 
0-9348 0220 
+6449 3407 


0-4903 5776 
-3949 3407 
-3303 5776 
-2838 2296 
-2487 2510 


0-2213 2296 
+1993 4239 
-1813 2296 
*1662 8454 
*1535 4518 


0-1426 1590 
-1331 3701 
*1248 3812 
-1175 1201 
-1109 9729 


0-1051 6634 
-0999 1696 
-0951 6634 
-0908 4666 
‘0869 0187 


0-0832 8522 
‘0799 5743 
‘0768 8522 
-0740 4027 
‘0713 9826 


0-0689 3823 
-0666 4201 


es oc tae bla) = 
(a) = = log Ta), y'(a) = 


¥"(a) 
2-4041 1381 


0-8287 9664 
-4041 1381 


0-2362 0405 
-1541 1381 
*1082 0405 
-0800 3973 
-0615 5682 


0-0487 8973 
-0396 0895 
‘0327 8973 
-0275 8791 
-0235 3047 


0-0203 0525 
-0176 9957 
-0155 6451 
-0137 9332 
-0123 0785 


0-0110 4984 
-0099 7514 
-0090 4984 
‘0082 4747 
0075 4721 


0-0069 3244 
-0063 8980 
-0059 0844 
+0054 7947 
-0050 9555 


0-0047 5060 
-0044 3952 


d 


ia y(a), ete. 


Table A. Values of the logarithmic derivatives of the gamma function 


va) 
6-4939 3940 
1-4090 9103 

-4939 3940 


0-2239 0585 
-1189 3940 
-0703 0585 
*0448 6533 
-0303 2251 


0-0214 2783 
-0156 9059 
-0111 8278 
-0091 3366 
-0071 9820 


0:0057 7244 
-0046 9924 
-0038 7614 
-0032 3440 
-0027 2673 


0-0023 1990 
-0019 9001 
‘0017 1990 
‘0014 9646 
-0013 1009 


0-0011 5341 
‘0010 2074 
-0009 0765 
‘0008 1066 
‘0007 2701 


0-0006 5448 
-0005 9128 
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EDITOR: AL NOTE 


The preceding papers by Severo & Zelen and by Barton, David & O’Neill, both of which 
contain suggestions for approximating to the probability integral of non-central F, were 
received for publication within a few days of each other. The first paper uses the normal 
approximation to the cube root of both x? and non-central y?, and then adopts the device 
(which seems first to have been suggested by David & Johnson, 1951) for determining 
isolated values of the probability integral of the ratio of two independent variables. The 
second paper first derives the cumulants of the logarithm of non-central F, and then applies 
to the distribution of this statistic, or rather to z* = 4log F*, various forms of inversion 
of an Edgeworth type expansion. 

Severo & Zelen have compared their approximation with that of Patnaik which was 
based on representing the distribution of F* by a central F distribution having the correct 
first two moments. It seems desirable also to compare their approximation with that of 
Barton et al.; this has been done by taking some of the cases examined by the latter authors 
in their Table 2 and applying to them the Severo & Zelen procedure. 

The accompanying table suggests that at any rate for the combination of parameters 
chosen, there is on the whole little difference in accuracy between the Barton e¢ al. Series II 
expansion and the Severo & Zelen method. It will be noted, however, that the results 
obtained by fitting Johnson’s S,, distribution to that of z*, using four moments, are almost 
invariably the most accurate. ; E.S.P. 


REFERENCE 
Davip, F. N. & Jonnson, N. L. (1951). Biometrika, 38, 43-57. 
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Approximations to P{z* < z,} = P{F* < F,} 
Case: A= 0-5, f, =f, = 10 





eet | 


Error in approximation 
= as 











Case: A= 1-0, f, = 10, f, = 20 
A 





c 


Exact 
value 


0-9918 
*9843 
+9288 


+4321 
0364 


-0069 
-0034 


7 
Error in approximation 
A 





Severo 

Series I Series II & Zelen 
-—10 1 —1 
-—- 9 4 —2 
0 5 1 
9 —8 —4 
3 5 2 
8 4 3 
7 0 3 


Case: A = 3-0, a = 0-05 


ee 





~ 


Error in approximations 
A 





a ‘ 
Severo 





Exact Severo 
a value Series I SeriesII & Zelen 
0-005 0:9940 1 -1 —4 
01 ‘9881 0 —2 —4 
05 -9423 —-3 1 —2 
50 +4699 q -1 —1 
95 -0431 —4 0 2 
99 -0084 0 1 3 
995 0041 1 1 3 
Errors are given as units in the fourth decimal place. 
Case: A= 3:0, «= 0-01 
A gen 
Error in approximations 
Exact Severo 
value Series II S, & Zelen 
| A AG RS 0-975 —4 0 -l1l1 
4 *957 11 1 — 2 
10 -920 10 1 1 
20 *895 3 0 4 
Case: A= 5-0, a= 0-01 
a —  ? 
Lj=L1,=2 0-978 —6 0 —12 
4 -960 0 0 — 2 
10 916 4 1 1 
20 *878 5 1 2 


Exact 

value Series IT Be & Zelen 

0-881 10 0 —5 
“824 4 -1 2 
*752 — 6 —3 7 
‘718 —10 —6 10 

Case: A = 5-0, a = 0-05 

Rams ‘ 

0-892 4 1 —65 
+833 4 0 1 
738 -1 0 3 
681 —2 0 6 


Errors are given as units in the third decimal place. 
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Tables for making inferences about the variance 
of a normal distribution 


By D. V. LINDLEY, D. A. EAST anp P. A. HAMILTON 
Statistical Laboratory, Cambridge 


InNTRODUCTION—BY D. V. LINDLEY 


1. Neyman & Pearson (1936) showed that if we have a random sample of size n from a 
normal distribution of zero mean and unknown variance o*, then an unbiased region of 
type A with size « for testing the null hypothesis that o = o, against the alternative a + o, 
is obtained by using the statistic 


n 
v= > x/o5 (1) 
i=1 
(which, on the null hypothesis, has a x?-distribution on n degrees of freedom) and rejecting 
whenever v < v, Or v > V2, where v, and v, are so chosen that 


piv < V1|F) + p(v 2 V2|05) =a (2) 
and vin ebe = yh" e-Mr, (3) 


(Cf. equations (138)—(142) of the paper cited.) By using the results of Neyman (1935) it is 
possible to show that if the mean y is also unknown, and therefore a nuisance parameter, 
an unbiased region of type B with size « for testing the same hypothesis is obtained by using 
the statistic 

v= ¥ (x;—Z)*/05 


and rejecting whenever wv’ < v, or v’ > v3, where v; and v4 satisfy (2), for all ~, and (3), with 
primes attached to the v’s and n replaced by n—1. In both these situations then a two- 
sided test based on the x?-distribution is used but instead of using equal tail-areas (with 4a 
in each tail) the areas are chosen so that the critical values obey (3). Notice that, introducing 
the same constant {2+ ['[4(n + 2)]}—1 on both sides of (3), the constraint (3) says that the 
ordinates of a y?-distribution on (n+ 2) degrees of freedom must be equal at the critical 
values v, and v,. The usual connexions between tests of hypotheses and confidence intervals 
enable us to say that the interval for a? derived in the usual way from this test, i.e. from 


P(r, < (2x*)/o* < vy) = 1-a 


is the best unbiased confidence interval. The present tables give values of v, = xj and 
V, = x3 for degrees of freedom proceeding by integers from 1 to 100, and a = 0-05, 0-01 
and 0-001. 

The tables were not prepared in order to derive the best unbiased tests but for a different 
reason. Let us consider again a random sample of size n from a normal distribution of zero 
mean and unknown variance and consider what we can say about the variance on the 
basis of the sample. If we use a Bayes approach there are strong, but not completely con- 
vineing, reasons for assuming a priori that Ino is uniformly distributed over the whole 
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real line. It is then easy to see that the posterior distribution of o? is such that ( > 2) / o 
i=l 
is distributed as x? on n d.f. (see, for example, Jeffreys (1948), § 3-41). That is 


p(o* |x, ...,%_) OC aX? [—(Za*)/207]. (4) 
This posterior distribution expresses our knowledge of the variance after the sample has 
been taken. It would be enough to quote this distribution in any given case but it is obviously 
convenient, and in line with modern practice, to quote an interval within which o? has high 
(e.g. 95%) posterior probability of lying. Furthermore, this interval should be such that 
points within the interval have higher posterior density than points without it, and this 
additional requirement would determine a unique interval, which would be the shortest 
containing a given amount of the posterior probability. Unfortunately, the requirement is 
not invariant under a transformation of the parameter, because a density is not invariant, 
and we have to specify the function of o that interests us. Since we have assumed Ino 
uniform a priori it seems natural to look at the same function a posteriori. The posterior 
distribution of u = Ing is proportional to 


e—™ exp [ — (2x?) /2e] 


and our interval of wu contains points where this exceeds some value, which itself is chosen 
so that the interval contains a predetermined posterior probability. Hence the critical 
values w, and u, satisfy 


e-™4 exp [ — (Z2x?)/2e%%] = e~™2 exp [ — (Z2x?)/2e%s], 
or letting v = (X2?)/o? = (Zax?)/e™, 


vin e-}% = vin e-}%s 


which is (3) again. Since v has a x?-distribution even when o? (and not =x?) is regarded as 
the variable the problem of finding the shortest interval in In o containing an amount (1 —) 
of the posterior distribution is computationally the same as the problem of finding the best 
unbiased confidence interval. The parallelism persists if 7 is unknown and assumed to have 
a uniform prior distribution independent of In 7: the degrees of freedom are reduced by one 
in the usual way. The reason for the parallelism is that the distribution of }1n (22) has Ing 
as a location parameter and hence there is a symmetry between operations in the sample 
space and parameter space when the latter is described by Ina. 

The tables also provide solutions of the following problem: find the shortest interval of 
the posterior distribution of o? containing probability (l1—«). It is only necessary to 
decrease the degrees of freedom by 2 and use the tabulated values. The proof of this is 
straightforward on integrating by parts. With one and two degrees of freedom the mode 
of the x?-distribution is at the origin and the shortest interval is one-sided and may be 
found from the usual tables. 


2. The tables were computed by Method II of Neyman & Pearson (1936, Appendix IT) 
with one modification. We require to find an interval (x7, v3) of the x?-distribution on v 
degrees of freedom containing probability (1—«) (equation (2)) which is such that the 
ordinates of the ?-distribution on (v + 2) degrees of freedom at xj and x3 are equal (equation 
(3)). The values are clearly unique. For any v we have an approximation ¥j to the required 
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value of x7 obtained from the lower }a point of the distribution. With this value we 
obtain a solution 73 of the equation in x 


(xa)*" exp (— 4X7) = ain ete (5) 


derived from (3). With these values of x7 and 3 the probability 1—« will be too small and 
we repeat the process with a smaller value of x7, continuing until we converge to the required 
probability. The only way we differ from Neyman & Pearson is in the solution of (5). The 
method proposed by them is to start from a guess 23 (for example, the upper $a point of 
x?) and use an iterative process which is of first order (see Hartree (1952), § 9-3). Instead we 
used Newton’s iterative procedure (ibid. §9-31) which is of second order and therefore 
converges more rapidly to the required value. For even v the integrals of y? involve only 
the exponential function. The calculations for these values were carried out on EDSAC II 
at the Mathematical Laboratory, Cambridge, with a programme drawn up by two of us 
(D. A. E. and P. A. H.). This made use of the values of the exponential function which are 
held in the reserved store of the machine as a permanent subroutine. They were carried 
through to seven significant figures and rounded off to the five given in the tables. Differ- 
ences were checked by hand and used to interpolate approximate values for small odd 
degrees of freedom, other than one. These interpolated values were used as starting values 
for the same iterative procedure carried through on a desk machine using tables of the 
normal distribution function. (This function is not available as a permanent subroutine.) 
The procedure was carried through with each odd degree of freedom until the interpolate 
using fourth differences was found to be accurate to five significant figures: the values for 
higher odd degrees of freedom were then obtained by interpolation. The values for v = 1 
were found similarly. 

Since these calculations were carried out Tate & Klett (1959) have published a similar 
table (Table 680). We have checked our values against theirs and have found discrepancies, 
particularly in the 0-1°% values. We believe, after some further checking, that our values 
are correct and Klett writes in a private communication that he thinks some error may have 
been made in their calculations. They also mention some tables of Rao’s (1952, p. 223): 
these also seem to be in error. 


We are grateful to the Director of the Mathematical Laboratory for permission to use 
the machine, and to the staff of the Laboratory for their co-operation. 
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’ Abi a ~~ 
v Xi Xs 
l 0-0931593 —-7-8168 
2 0-084727 9-5303 
3 0-29624 11-191 
4 0-60700 12-802 
5 0-98923 14-369 
6 14250 15-897 
7 1-9026 17-392 
8 2-4139 18-860 
9 2-9532 20-305 
10 35162 21-729 
11 4-0995 23-135 
12 4-7005 24-525 
13 53171 25-900 
14 5+9477 27-263 
15 6-5908 28-614 
16 17-2453 29-955 
17 7-9100 31-285 
18 8-5842 32-607 
19 9-2670 33-921 
20 9-9579 35-227 
21 10-656 36-525 
22 11-361 37-818 
23 12-073 39-103 
24 12-791 40-383 
25 13-514 41-658 
26 14-243 42-927 
27 14-977 44-192 
28 15-716 45-451 
29 16-459 46-707 
30 17-206 47-958 
31 17-958 49-205 
32 18-713 50-448 
33 19-472 51-688 
34 20-235 52-924 
35 21-091 54-157 
36 21-771 55-386 
3 22-543 56-613 
38 23-319 57-836 
39 24-097 59-057 
40 24-879 60-275 
41 25-663 61-490 
42 26-449 62-703 
43 27-238 63-913 
44 28-029 65-121 
45 28-823 66-327 
46 29-619 67-530 
47 30-417 68-731 
48 31-218 69-931 
49 32-020 71-128 
32-824 72-323 
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1% 

Xi x2 
0-0°13422 11-345 
0-017469 13-285 
0-101048 15127 
0-26396 16-901 
0-49623 18-621 
0-78565 20-296 
1-1221 21-931 
1-4978 23-533 
1-9069 25-106 
2-3444 26-653 
2-8069 28-178 
3-2912 29-683 
3°7949 31-170 
4-3161 32-641 
4:8530 34-097 
5-4041 35-540 
5-9683 36-971 
6-5444 38-390 
7-1316 39-798 
71-7289 41-197 
8+3358 42-586 
8-9515 43-967 
9-5755 45-340 

10-2073 46-706 
10-846 48-064 
11-492 49-416 
12-145 50-761 
12-803 52-100 
13-468 53-434 
14-138 54-762 
14-813 56-085 
15-494 57-403 
16-179 58-716 
16-869 60-025 
17-563 61-330 
18-261 62-630 
18-964 63-927 
19-670 65-219 
20-380 66-508 
21-094 67-793 
21-811 69-075 
22-531 70-354 
23-255 71-629 
23-982 72-901 
24-712 74-170 
25-445 15-437 
26-181 76-700 
26-919 77-961 
27-660 79-220 
28-404 80-475 











23-816 





0-1% 
xi Xe 
0-0°14026 16-266 
0-0718055 18-468 
0022097 20-524 
0-083097 22-486 
0-19336 24-378 
0-35203 26-214 
0-55491 28-004 
0-79722 29-754 
1-0745 31-469 
13827 33-154 
1-7185 34-812 
2-0791 36-446 
2-4620 38-058 
2-8651 39-650 
3-2865 41-225 
37248 42-783 
41786 44-325 
46468 45-854 
5-1281 47-370 
5-6218 48-874 
6-1269 50-366 
6-6428 51-848 
7-1688 53-320 
7:7043 54-782 
8-2487 56-236 
8-8016 57-682 
9-3625 59-119 
9-9310 60-549 
10-507 61-972 
11-089 63-388 
11-678 64-798 
12-274 66-202 
12-875 67-599 
13-482 68-991 
14-094 70-378 
14-712 71-759 
15-335 73-136 
15-963 74-507 
16-595 15-874 
17-232 17-236 
17-873 78-595 
18-518 79-948 
19-168 81-298 
19-821 82-645 
20-478 83-987 
21-139 85-326 
21-803 86-661 
22-471 87-992 
23-142 89-321 
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5% 1% 01% 
€- — ™~ Ee ¢ ‘ 
v 2 xe xi % x 4 
51 33-630 73-516 29-150 81-729 24-494 91-968 
52 34-439 74-708 29-898 82-979 25-174 93-287 
53 35-248 75°897 30-649 84-228 25-858 94-603 
54 36-060 77-085 31-403 85-474 26-544 95-916 
55 36-873 78-271 32-158 86-718 27-233 97-227 
56 37-689 79-456 32-916 87-960 27-925 98-535 
57 38-505 80-639 33-675 89-200 28-620 99-840 
58 39-323 81-820 34°437 90-437 29-317 101-142 
59 40-143 83-000 35-201 91-673 30-016 102-442 
60 40-965 84-178 35-967 92-907 30-719 103-74 
61 41-787 85-355 36-735 94-139 31-423 105-03 
62 42-612 86-531 37-504 95-369 32-130 106-33 
63 43-437 87-705 38-276 96-597 32-839 107-62 
64 44-264 88-878 39-049 97-823 33-551 108-91 
65 45-092 90-049 39-824 99-048 34-264 110-19 
66 45-922 91-219 40-600 100-271 34-980 111-48 
67 46-753 92-388 41-379 101-492 35-698 112-76 
68 47-585 93-555 42-159 102-71 36-418 114-04 
69 48-418 94-722 42-940 103-93 37-140 115-32 
70 49-253 95-887 43-723 105-15 37-864 116-59 
71 50-089 97-051 44-508 106-36 38-590 117-87 
72 50-926 98-214 45-294 107-58 39-317 119-14 
73 51-764 99-376 46-081 108-79 40-047 120-41 
74 52-603 100-536 46-870 110-00 40-778 121-68 
75 53-443 101-696 47-661 111-21 41-51} 122-94 
76 54-284 102-85 48-452 112-42 42-246 124-21 
77 55-126 104-01 49-245 113-62 42-983 125-47 
78 55-969 105-17 50-040 114-83 43-721 126-73 
79 56-814 106-32 50-836 116-03 44-461 127-99 
80 57-659 107-48 51-633 117-23 45-203 129-25 
81 58-505 108-63 §2-431 118-44 45-946 130-51 
82 59-352 109-79 53-230 119-64 46-690 131-76 
83 60-200 110-94 54-031 120-84 47-436 133-02 
84 61-049 112-09 54-833 122-03 48-184 134-27 
85 61-899 113-24 55-636 123-23 48-933 135-52 
86 62-750 114-39 56-440 124-43 49-684 136-77 
87 63-601 115-54 57-245 125-62 50-436 138-02 
88 64°454 116-68 58-052 126-81 51-189 139-26 
89 65-307 117-83 58-859 128-01 51-944 140-51 
90 66-161 118-98 59-668 129-20 52-700 141-75 
91 67-016 120-12 60-477 130-39 53-457 142-99 
92 67-871 121-26 61-288 131-58 54-216 144-23 
93 68-728 122-41 62-100 132-76 54-976 145-47 
94 69-585 123-55 62-912 133-95 55-738 146-71 
95 70-443 124-69 63-726 135-14 56-500 147-95 
96 71-302 125-83 64-540 136-32 57-264 149-19 
97 72-161 126-97 65-356 137-51 58-029 150-42 
98 73-021 128-11 66-172 138-69 58-795 151-66 
99 73-882 129-25 66-990 139-87 59-562 152-89 
100 74-744 130-39 67-808 141-05 60-331 154-12 


The values of yj and x3 satisfy the equations 


x} co 
i) + 2-{P(4y)}-te-He ah! dex = a 
9 xt 


and (xi)t? e-txd = (x3)! etait 
for « = 0-05, 0-01 and 0-001. 
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Tables for the solution of the exponential equation, exp(—a)+ka=1 


By D. E. BARTON, F. N. DAVID} anp M. MERRINGTON 
University College London 


David & Johnson (1952) pointed out that the estimation by maximum likelihood of the 
parameter of a Poisson distribution when the zero group is missing reduces to the solution 
of the equation 4 

ia ————, 
1—e-“ 
where % is the mean of the N known observations and A is the Poisson parameter. 
Recently (Barton & David, 1961) we have been investigating approximations to the 


difference quotients of zero, i.e. to Ani 


n! 





for values of n outside the range of existing tables. Various approximations have recently 
been proposed, Arfwedson (1951), Binet & Szekeres (1957) and Hsu (1948). Incomparably 
the best of any put forward are those given by Laplace, Théorie Analytique des Probabilités 
(1820), Livre 1, p. 162. Laplace’s approximation to A”0‘ depends on the solution for a of 


These two requirements for the solution of this exponential equation will possibly not be 
the only contexts in which it intervenes in statistical practice. From the combinatorial 
point of view they seem to us, by themselves, to be sufficient justification for the computa- 
tion of the table which is given in this paper. 


CONSTRUCTION OF THE TABLE 


We considered the solution of the equation 
e*+ka = 1, 


where k is known, and the solution for a is required. For values of k = 0-050 (0-001) 0-190, 
a was found approximately by building up a value of k—! — a from third differences, choosing 
an approximate value for a and solving for a by iteration. For k = 0-190(0-001)1-000 a table 
of the approximate value of a was built up assuming constant fifth differences, the exact 
value of a then being found by iteration. For k < 0-05 it is enough to assume 


=. 
=7 
since this approximation overestimates a by less than 4-2 x 10-°. The table was checked 


on the Mercury computer with the help of the staff of the University of London Computer 
Unit. 


{ With the partial support of the office of Naval Research while at the University of California, 
Berkeley. 
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Example 1 


Van Rest (1937) in his paper on Examples of Statistical Methods in Forest Products 
Research gives the following table in which the expected frequencies (i) are calculated by 
treating x—1 as a Poisson variable, where z is the number of vessels in a group. 


Frequency of occurrence of different-sized growps of vessels in the wood of 
Shorea leprosula 


No. of Expected Expected 
vessels in frequency frequency 
group Frequency (i) (ii) 
1 843 838-5 843 
2 143 151-9 144 
3 18 13-7 17 
4 1 0-8 1 
Total 1005 1005 1005 


The mean of the distribution is = 1-1811 whence k = 1/% = 0-8467. From the table, 
a = X = 0-3426. Poisson probabilities with this parameter were calculated. The expected 
frequencies (ii) are these probabilities divided by their total of 0-2901 and multiplied by 
1005. The fit by maximum likelihood, assuming that the distribution is a Poisson with 
zero group missing, is seen to give better results than the method of graduation used by 


Van Rest. 
Example 2 
Stevens (1937) gave a table of Aoi 
n! 


for n = 2(1)...4, ¢ = 2(1)25. The values of the difference quotients of zero are accordingly 
only required outside this range and for test purposes, calculations at 1 = 20 will provide 
a severe check on any approximation. Laplace gave what is equivalent to the relation 
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For i = 20 the approximate values of the difference quotients were calculated from this 
formula, from De Moivre’s (1756) formula, and from formulae recently proposed by Binet & 
Szekeres (1957), Arfwedson (1951), and Hsu (1948) who had been anticipated by Cayley 


(1881). The proportionate errors, namely (approximate value—true value)/(true value). 
multiplied by 100 are given in the following table. 
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Relative error (approximate valuetrue value)|(true value) expressed as a percentage 
using five different approximations for the difference quotients of zero (i = 20) 


Binet & 

n Laplace De Moivre Szekeres Arfwedson Hsu 

3 0-005 0-000 0-133 2-947 — 100-000 

4 0-012 0-006 0-266 2-407 — 100-000 

5 0-008 0-101 6-405 2-093 — 99-987 

6 — 0-001 0-633 1-036 1-893 — 99-823 

7 — 0-010 2-309 3-167 1-741 — 98-755 

8 — 0-019 6-190 8-302 1-631 — 94-694 

9 — 0-026 13-780 18-636 1-557 — 84-660 
10 — 0-032 27-389 37-757 1-514 — 67-397 
1l — 0-037 51-000 72-343 1-504 — 45-775 
12 — 0-042 92-238 136-294 1-530 — 25-538 
13 — 0-046 167-151 261-639 1-598 — 11-256 
14 — 0-049 313-045 530-772 1-726 — 3-721 
15 — 0-053 627-365 1185-312 1-940 — 0-848 


Laplace’s approximation becomes closer to the true value with increasing 7. It is re- 
markably good and can obviously be used with confidence for the calculation of any value 
or set of values outside the range of Stevens’s tables. 

It is of interest to note that, if we write 


1 
%=—-7, y= ue 
then the second real root of ze* = y, 


Thus our table may be considered, essentially, as tabulating, for negative y, that of the two 
roots which is less in modulus than unity, in terms of the other. When y is positive the 
equation has only one real root (necessary, incidentally, for the application of the Binet-— 
Szekeres method). We shall treat the equation in this range, in a future paper, since it is a 
useful auxiliary in Laplace’s expansion for the Differences of the Reciprocals of Unity. 
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k a k 
0-050 | 20-0000000 | 0-100 
‘051 | 19-6078 431 101 
-052 |19-2307691 -102 
‘053 | 18-8679 244 -103 
054 |18-5185184 -104 
9-055 |18-1818180 | 0-105 
-056 | 17-8571425 -106 
-057 | 17-5438 592 -107 
-058 |17-2413787 -108 
‘059 | 16-9491518 -109 
0-060 | 16-6666657 | 0-110 
‘061 | 16-3934414 ‘lll 
-062 | 16-1290307 *112 
‘063 | 15-8730138 “113 
-064 | 15-6249974 *114 
0-065 |15-3846122 | 0-115 
066 |15-1515112 -116 
‘067 | 14-9253 682 +117 
‘068 | 14-7058 763 -118 
‘069 | 14-4927 463 *119 
0-070 | 14-2857054 | 0-120 
‘O71 | 14-0844963 121 
‘072 | 13-8888 760 +122 
‘073 | 13-6986 147 +123 
‘074 |13-5134952 +124 
0-075 |13-3333117 | 0-125 
‘076 |13-1578693 -126 
‘077 | 12-9869 832 +127 
‘O78 | 12-8204781 -128 
‘079 | 12-6581876 +129 
0-080 | 12-4999534 | 0-130 
‘081 | 12-3456 253 “131 
‘082 | 12-1950603 +132 
‘083 | 12-0481 222 *133 
084 |11-9046814 +134 
0-085 |11-7646144 | 0-135 
‘086 | 11-6278033 +136 
‘087 |11-4941358 *137 
088 | 11-3635044 *138 
089 | 11-2358068 +135 
0-090 |11-1109450 | 0-140 
‘091 | 10-9888 254 *141 
‘092 | 10-8693583 -142 
‘093 | 10-7524581 -143 
-094 | 10-6380427 +144 
0-095 | 10-5260334 | 0-145 
‘096 | 10-4163548 -146 
‘097 | 10-3089 347 +147 
‘098 | 10-2037 037 “148 
-099 | 10-1005 954 -149 
0-100 9-9995458 | 0-150 

















a k a k a k a 
9-9995458 | 0-150 | 6-6581095 | 0-200 | 4-9651142 | 0-250 | 3-9206904 
9-9004 937 *151 | 66136295 +201 | 4-:9395120 +251 | 3-9037180 
9-8033 798 +152 | 6-5697 225 +202 | 49141487 +252 | 38868671 
9-7081477 +153 | 65263771 +203 | 48890207 +253 | 3-8701363 
9-6147 429 +154 | 64835823 +204 | 48641246 +254 | 38535241 
9-5231129 | 0-155 | 64413272 | 0-205 | 4-8394568 | 0-255 | 3-8370292 
9-4332073 -156 | 6-3996012 -206 | 48150140 +256 | 3-8206502 
93449775 -157 | 6°3583940 *207 | 4-7907929 -257 | 3°8043857 
9-2583 768 *158 | 6:3176956 +208 | 4°7667902 +258 | 3°7882344 
9-1733599 +159 | 6-2774962 +209 | 47430026 -259 | 3°7721949 
9-0898836 | 0-160 | 6-2377864 | 0-210 | 4-7194272 | 0-260 | 3-7562660 
9-0079 060 -161 | 6-1985568 *211 | 46960608 +261 | 3°7404463 
8-9273 866 -162 | 6-1597983 +212 | 46729003 +262 | 37247347 
8-8482 865 +163 | 61215021 +213 | 46499430 +263 | 3-7091299 
8-7705 681 -164 | 60836596 -214 | 4-6271857 +264 | 3-6936307 
86941952 | 0-165 | 6-0462625 | 0-215 | 4-6046258 | 0-265 | 3-6782358 
8-6191326 -166 | 60093024 *216 | 4:5822605 +266 | 3-6629441 
85453 466 -167 | 59727714 +217 | 45600869 *267 | 3-6477545 
8-4728 044 -168 | 5-9366617 *218 | 45381024 +268 | 3-6326657 
8-4014745 -169 | 59009657 +219 | 45163044 269 | 3-6176767 
83313262 | 0-170 | 58656758 | 0-220 | 4-4946903 | 0-270 | 3-6027863 
82623301 “171 | 58307850 +221 | 4:4732575 +271 | 3-5879935 
8°1944575 *172 | 57962859 +222 | 44520036 *272 | 3°5732972 
8-1276809 ‘173 | 5:7621718 +223 | 44309262 -273 | 3°5586962 
80619 734 17 5:7284359 224 | 4-4100228 +274 | 3-5441897 
7-9973091 | 0-175 | 5-6950714 | 0-225 | 4:3892910 | 0-275 | 3-5297765 
7-9336 629 ‘176 | 5:6620721 +226 | 4-3687286 -276 | 3-5154556 
7:8710106 “177 | 56294315 +227 | 43483333 *277 | 3-5012261 
78093 287 “178 | 55971436 +228 | 4-3281028 *278 | 3-4870869 
7-7485 942 “179 | 55652022 +229 | 4-3080351 +279 | 3-4730370 
7-6887851 | 0-180 | 5-5336015 | 0-230 | 4-2881278 | 0-280 | 3-4590756 
7-6298 800 “181 | 5-5023357 +231 | 4-2683789 *281 | 3-4452017 
7-5718581 *182 | 5-4713992 +232 | 42487864 +282 | 3-4314143 
7-5146991 ‘183 | 54407865 +233 | 42293482 -283 | 3°4177125 
7°4583 837 *184 | 54104922 +234 | 4-2100622 +284 | 3-4040955 
7-4028927 | 0-185 | 5-3805110 | 0-235 | 4-1909266 | 0-285 | 3-3905624 
7:3482078 ‘186 | 5-3508378 *236 | 4:1719393 +286 | 3-3771122 
7-2943 110 ‘187 | 5:3214675 +237 | 4°1530985 -287 | 3-3637441 
7-2411851 “188 | 52923952 *238 | 41344024 *288 | 3°3504572 
7-1888 131 -189 | 52636161 *239 | 41158490 *289 | 3-3372508 
7-1371786 | 0-190 | 5-2351255 | 0-240 | 4-0974366 | 0-290 | 3-3241240 
7-0862 658 -191 | 52069187 +241 | 4-0791634 *291 | 3-3110759 
7-0360 593 *192 | 5-1789912 +242 | 4:0610277 -292 | 3-2981058 
6-9865 438 ‘193 | 5-1513386 +243 | 40430277 *293 | 32852129 
6-9377 049 -194 | 5-1239566 +244 | 40251617 +294 | 3-2723964 
6-8895 283 | 0-195 | 5-0968408 | 0-245 | 4-0074282 | 0-295 | 3-2596555 
6-8420 002 -196 | 5-0699872 -246 | 3-9898 254 +296 | 3-2469895 
6°7951072 ‘197 | 50433917 +247 | 3-9723518 -297 | 3-2343976 
67488 362 -198 | 5-0170503 -248 | 3-9550058 -298 | 3-2218790 
6-°7031 744 -199 | 4:9909591 +249 | 3-9377858 -299 | 3-2094331 
6-6581095 | 0-200 | 4-9651142 | 0-250 | 3-9206904 | 0-300 | 3-1970591 


























N.B. for k < 0-05, take a = 1/k. 
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Table for the solution of the equation exp (—a)+ka = 1 
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a k a k 
3-1970591 | 0-350 | 2-6566127 | 0-400 
3°1847 564 *351 2-6471411 -401 
3°1725 241 +352 | 2-6377143 -402 
3-1603617 *353 | 2-6283321 -403 
3-1482 684 354 | 2-6189939 -404 
3-1362436 | 0-355 | 2-6096996 | 0-405 
3°1242 866 -356 | 2-6004487 -406 
3-1123 968 *357 2-5912409 *407 
3-1005 735 +358 | 2-5820758 -408 
3-0888 160 +359 | 2-5729530 -409 
3-0771238 | 0-360 | 2-5638723 | 0-410 
3-0654 961 +361 | 2-5548333 ‘411 
3-0539 325 +362 | 2-5458 356 -412 
3-0424 323 +363 | 2-5368790 -413 
3-0309 949 +364 | 2-5279631 +414 
3-0196198 | 0-365 | 2-5190875 | 0-415 
3-0083 062 -366 | 2-5102520 -416 
2-9970537 *367 2-5014563 *417 
2-9858 617 -368 | 2-4927000 -418 
2-9747 297 +369 | 2-4839828 -419 
2-9636570 | 0-370 | 2-4753044 | 0-420 
2-9526 432 “371 | 2°4666645 -421 
2-9416876 +372 | 2-4580629 +422 
2-9307 898 +373 | 2-4494991 -423 
2-9199 493 +374 | 2-4409730 +424 
2-9091655 | 0-375 | 2-4324843 | 0-425 
2-8984379 +376 | 2-4240326 -426 
2-8877 660 -377 | 2-4156176 +427 
2-8771 494 +378 | 2-4072391 -428 
2-8665 874 -379 | 2-3988969 -429 
2-8560797 | 0-380 | 2-3905906 | 0-430 
2-8456 257 -381 | 2-3823199 431 
2-8352 249 +382 | 2-3740846 -432 
28248 770 *383 | 2°3658845 433 
2-8145814 -384 | 2:3577192 +434 
2-8043377 | 0-385 | 2-3495885 | 0-435 
2-7941 455 +386 | 2:3414922 +436 
2-7840 042 +387 | 2°3334300 437 
2-7739 134 -388 | 2-3254016 +438 
2-7638 728 -389 | 2-3174068 -439 
2-7538818 | 0-390 | 2-3094453 | 0-440 
2-7439 401 -391 2-3015170 *441 

| 2-7340472 +392 | 2-2936214 -442 
2-7242027 *393 | 2-2857585 +443 
2-7144062 +394 2-2779 280 +444 
2-7046573 | 0-395 | 2-2701297 | 0-445. 
2-6949 555 +396 | 2-2623632 +446 

| 2-6853 006 -397 | 2-2546284 -447 

| 2-6756921 -398 | 2-2469251 -448 
2-6661 296 +399 | 2-2392530 -449 
2-6566127 | 0-400 | 2-2316119 | 0-450 











a k a k a | 
2-2316119 | 0-450 | 1-8847348 | 0-500 | 1-5936243 
2-2240016 | -451 | 1-8784240 | -501 | 1-5882633 
2-2164218 | -452 | 18721351 | -502 | 1-5829188 
2-2088724 | -453 | 18658679 | -503 | 1-5775904 
2-2013532 | -454 | 18596224 | -504 | 1-5722783 
21938638 | 0-455 | 1-8533984 | 0-505 | 1-5669823 
2-1864042 | -456 | 1-8471958 | -506 | 1-5617022 
21789740 | -457 | 18410145 | -507 | 1-5564381 
21715732 | -458 | 18348542 | -508 | 1-5511898 
2-1642015 | -459 | 1-8287149 | -509 | 1-5459572 
21568586 | 0-460 | 1-8225965 | 0-510 | 1-5407403 
21495444 | -461 | 18164989 | -511 | 1-5355389 
2-1422588 | -462 | 1-8104218 | -512 | 1-5303531 
21350014 | -463 | 1-8043652 | -513 | 1-5251826 
2-1277721 | -464 | 1-7983290 | -514 | 1-5200275 
21205707 | 0-465 | 1-7923131 | 0-515 | 1-5148876 
21133971 | -466 | 1-7863172 | -516 | 1-5097628 
2-1062510 | -467 | 1-7803413 | -517 | 1-5046532 
2-0991322 | -468 | 1-7743854 | -518 | 1-4995585 
2-0920406 | -469 | 1-7684491 | -519 | 1-4944788 
2-0849759 | 0-470 | 1-7625325 | 0-520 | 1-4894139 
20779381 | -471 | 1-7566355 | -521 | 1:4843637 
2-0709268 | -472 | 1-7507578 | -522 | 1-4793282 
2-0639420 | -473 | 1-7448995 | -523 | 1-4743074 | 
2-0569834 | -474 | 1-7390603 | -524 | 1-4693011 
2-0500510 | 0-475 | 1-7332402 | 0-525 | 1-4643092 
20431444 | -476 | 1-7274391 | -526 | 1-4593317 
2-0362635 | -477 | 1-7216568 | -527 | 1-4543685 
2-0294083 | -478 | 1-7158932 | -528 | 1-4494195 
2-0225784 | -479 | 1-7101483 | -529 | 1-4444847 
20157738 | 0-480 | 1-7044219 | 0-530 | 1-4395640 
20089942 | -481 | 1-6987139 | -531 | 1-4346573 | 
2-0022395 | -482 | 1-6930242 | -532 | 1-4297645 

1-9955095 | -483 | 16873527 | -533 | 1-4248856 
1-9888042 | -484 | 16816993 | -534 | 1-4200205 
1-9821232 | 0-485 | 1-6760639 | 0-535 | 1-4151691 
1-9754665 | -486 | 1-6704464 | -536 | 1-4103313 
1-9688339 | -487 | 16648467 | -537 | 1-4055072 
1-9622253 | -488 | 1-6592647 | -538 | 1-4006965 
1-9556405 | -489 | 1-6537002 | -539 | 1-3958994 
1-9490792 | 0-490 | 1-6481533 | 0-540 | 1-3911155 

| 19425415 | -491 | 1-6426237 | -541 | 1-3863450 
1-9360271 | -492 | 16371114 | -542 | 1-3815878 | 
1-9295360 | -493 | 16316164 | -543 | 1-3768437 | 
1-9230678 | -494 | 1-6261384 | -544 | 1-3721128 | 
1-9166226 | 0-495 | 1-6206774 | 0-545 | 1-3673948 | 
1-9102001 | -496 | 1-6152333 | -546 | 1-3626899 
1-9038002 | -497 | 1-6098061 | -547 | 1-3579979 | 
1-8974228 | -498 | 1-6043955 | -548 | 1-3533187 
1-8910677 | -499 | 15990016 | -549 | 1-3486523 
18847348 | 0-500 | 1-5936243 | 0-550 | 1-3439987 | 
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Table for the solution of the equation exp (—a)+ka=1 




















a a a a a 
1-3439 987 1-1262612 0-9336 939 0-7614337 0-6058 600 | 
1-3393 577 1-1221 820 -9300 635 -7581 691 -6028 986 
1-3347 293 1-1181127 *9264412 -7549 111 -5999 427 
1-3301 135 11140533 -9228 268 *7516 598 -5969 924 
1-3255 101 1-1100038 -9192 204 *7484 150 -5940 475 
1-3209 191 1-1059 641 0-9156 220 0-7451 767 | 0-5911081 
1-3163 405 1-1019342 *9120315 *7419450 -5881742 | | 
1-3117 742 1-0979 141 *9084.489 -7387 198 | +5852 457 
1-3072 201 1-0939 037 *9048 742 *7355010 +5823 227 
1-3026 782 1-0899 029 -9013073 | °7322887 | -5794050 
1-2981 485 1-0859 117 0-8977 481 0-7290 829 0-5764 927 
1-2936 307 1-0819 301 | °8941968 +7258 834 | +5735858 
1-2891 250 1-0779581 | +8906531 *7226 903 | -5706 842 
1-2846 312 1-0739 955 *8871172 *7195036 | *5677880 | 
1-2801 493 1-0700 424 *8835 889 *7163 232 | *5648970 | 
1-2756 792 1-0660 987 0-8800 683 0-7131491 0-5620 114 
1-2712 209 1-0621 643 *8765 553 -7099 813 | *5591310 
1-2667 743 1-0582 393 -8730 498 -7068 198 -5562 558 
1-2623 394 1-0543 236 *8695 519 -7036 645 +5533 859 
1-2579 161 1-0504171 *8660 616 *7005 154 +5505 213 
1-2535 043 1-0465 198 0-8625 787 0-6973 725 0-5476618 | 
1-2491 040 1-0426 317 *8591032 *6942 358 *5448 075 | 
1-2447151 1-0387 527 *8556 352 -6911053 *5419 584 | 
1-2403 377 1-0348 828 *8521746 *6879 808 -5391 144 | 
1-2359715 1-0310219 *8487 214 *6848 625 +5362 756 
1-2316 167 1-0271 701 0-8452 755 0-6817 503 0-5334419 | 
1-2272730 1-0233 272 *8418370 -6786 441 -5306 132 
1-2229 405 1-0194933 *8384057 *6755 440 5277897 | 
1-2186 192 1-0156 683 *8349 816 -6724499 -5249712 
1-2143089 1-0118 521 *8315 648 -6693 618 -5221578 | 
1-2100097 1-0080 447 0-8281 552 0-6662 796 0-5193 494 | 
1-2057 214 1-0042 461 +8247 528 +6632 035 -5165 460 
1-2014.440 1-0004 563 *8213575 -6601 332 -5137 476 
1-1971774 0-9966 752 *8179 694 -6570 689 +5109 542 
1-1929 217 0-9929 027 *8145 883 -6540 104 +5081 658 
1-:1886 768 0-9891 389 0-8112143 0-6509 579 0-5053 823 
1-1844 426 *9853 837 *8078 473 -6479 112 +5026 037 
1-1802 190 -9816371 *8044874 -6448 703 -4998 301 
1-1760060 -9778 989 *8011344 -6418 352 -4970613 
1-1718036 -9741 693 *7977 884 *6388 059 *4942 975 
1-1676118 0-9704481 0-7944493 0-6357 824 0-4915 385 
1-1634304 *9667 354 *7911171 -6327 646 -4887 843 
1-1592 594 9630310 -7877918 +6297 526 -4860 350 
1-1550988 *9593 350 *7844733 -6267 462 *4832 905 
1-1509 485 *9556 473 *7811617 *6237 456 -4805 508 
1-1468 085 0-9519679 0-7778 568 0-6207 506 0-4778 159 
1-1426788 *9482 967 +7745 587 -6177612 +4750 858 
1-1385 592 *9446 338 *7712674 *6147775 -4723 604 
11344498 -9409 790 -7679 828 -6117994 -4696 398 
1-1303 505 ‘9373 324 *7647 049 +6088 269 +4669 239 
1-1262 612 *9336 939 0-7614337 0-6058 600 
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0-800 | 0-4642128 | 0-850 | 0-3343447 | 0-900 | 0-2145557 | 0-950 | 0-1034788 | 
| -801 -4615 063 *851 +3318 552 901 +2122 529 “951 -1013381 
*802 -4588 045 +852 *3293 697 *902 +2099 535 *952 -0992005 
-803 -4561073 +853 +3268 882 -903 +2076 576 *953 -0970 658 
+804 -4534148 +854 +3244 107 904 -2053 652 *954 -0949 342 


| 0-805 | 0-4507270 | 0-855 | 0-3219371 | 0-905 | 0-2030762 | 0-955 | 0-0928 056 
| +806 -4480 438 *856 *3194675 -906 -2007 906 *956 | -0906 799 
*807 +4453 652 *857 -3170019 *907 -1985 084 *957 | -0885573 
-808 -4426911 *858 +3145 402 “908 *1962 296 *958 0864376 | 
-809 -4400217 *859 -3120824 -909 +1939 542 *959 -0843 209 


| 0-4373568 | 0-860 0-3096 286 | 0-910 | 0-1916824 | 0-960 | 0-0822071 | 
811 +4346 965 ‘861 +3071 786 ‘911 *1894137 961 -0800963 | 
*812 | -4320407 *862 +3047 325 *912 -1871484 -962 -0779 885 
‘813 -4293 894 +863 +3022 903 913 -1848 866 -963 -0758 836 
*814 +4267 426 *864 +2998 520 “914 +1826 281 964 ‘0737 816 


0-815 | 0-4241004 | 0-865 | 0-2974176 | 0-915 | 0-1803729 | 0-965 | 0-0716825 | 
*816 -4214626 *866 +2949 869 916 *1781 211 -966 0695 864 | 
‘817 -4188 292 *867 +2925 601 ‘917 +1758 725 -967 °0674932 | 
*818 -4162003 *868 +2901 372 ‘918 *1736 274 -968 0654028 | 
“819 -4135 759 *869 +2877 180 ‘919 *1713 855 -969 -0633 154 | 


| 0-820 | 0-4109558 | 0-870 | 0-2853027 | 0-920 0-1691469 | 0-970 | 0-0612308 | 
*821 +4083 402 ‘871 +2828 911 “921 -1669 116 ‘971 +0591 492 
+822 -4057 290 “872 +2804 833 922 -1646 795 “972 -0570 704 | 
*823 -4031 222 +873 -2780793 923 -1624508 ‘973 0549 944 
*824 +4005 197 “874 +2756 790 +924 -1602 253 “974 *0529 213 


| 0-825 | 0-3979215 | 0-875 | 0-2732825 | 0-925 0-1580031 | 0-975 | 0-0508511 
| +826 +3953 278 *876 +2708 897 *926 +1557 841 ‘976 -0487 837 
*827 -3927 383 *877 +2685 007 *927 +1535 683 977 -0467 191 
+828 +3901 532 ‘878 | +2661153 *928 +1513 558 ‘978 *0446 574 
*829 +3875 723 +879 *2637 337 *929 +1491 465 *979 0425 985 | 


0-830 | 0-3849957 | 0-880 | 0-2613557 | 0-930 | 0-1469404 | 0-980 | 0-0405424 
| +831 +3824 235 *881 +2589 815 931 °1447 374 981 -0384891 
+832 +3798 554 *882 +2566 109 +932 *1425377 +982 -0364 386 
+833 +3772916 *883 +2542 439 933 +1403 412 -983 -0343 909 
*834 +3747 321 “884 +2518 806 934 *1381478 “984 0323 460 | 


| 0-835 | 0-3721768 | 0-885 | 0-2495210 | 0-935 | 0-1359576 | 0-985 | 0-0303038 

*836 | +3696 257 “886 +2471649 *936 -1337 706 -986 0282 644 | 
+3670 787 +887 *2448 125 *937 *1315 867 *987 +0262 278 | 
“838 | +3645360 “888 -2424 637 -938 -1294060 -988 -0241939 | 
*839 -3619974 “889 +2401 185 *939 +1272 283 -989 -0221628 | 


0-840 | 0-3594630 | 0-890 | 0-2377769 | 0-940 | 0-1250538 0-990 | 0-0201345 | 
*841 *3569 327 891 +2354389 “941 *1228825 991 0181088 | 
"842 +3544 066 "892 | -2331044 942 | -1207142 *992 -0160859 | 
"843 | -3518846 893 | -2307735 943 | -1185490 -993 -0140 657 
+844 | -3493667 “894 +2284 461 "944 +1163 869 -0120482 


0-3468528 | 0-895 | 02261222 | 0-945 | 0-1142279 | 0-995 | 0-0100335 | 
*846 | +3443 431 *896 *2238019 *946 -1120720 -996 +0080 214 | 
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+3418 374 +897 -2214851 947 -1099 191 ‘997 -0060 120 | 
848 | -3393358 “898 -2191718 -948 *1077 693 -998 0040053 | 
“849 +3368 383 “899 +2168 620 *949 +1056 226 “999 -0020013 | 


0-850 | 0-3343447 | 0-900 | 0-2145557 | 0-950 | 0-1034788 | 1-000 | 0-0000000 | 
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Studies in the history of probability and statistics. 
X. Where shall the history of statistics begin? 


By M. G. KENDALL 
Research Techniques Division, London School of Economics and Political Science 


1. A history must start somewhere, but history has no beginning. It is therefore natural, or at least 
fashionable, for the historian of any particular period or of any particular subject to preface his main 
treatment by tracing the roots of his theme back into the past as far as he possibly can. The writer on any 
modern idea who can claim that the Chinese thought of it first in the Shang period is usually regarded as 
having scored a point. The underlying assumption that historical development is continuous is sometimes 
justifiable and sometimes, though not justifiable, innocuous. A history of marine insurance from the 
foundation of Edward Lloyd’s coffee house in 1712 may reasonably begin with an account of the sea-laws 
of Rhodes of two thousand years earlier. There is no great harm in a history of Newmarket race course 
glancing at Eohippus and passing lightly over the chariot races of the ancient world before lining up at 
the starting post of a.p. 1640. 

2. But there are dangers in pursuing the roots of a subject down to its slenderest fibrils. A word, an 
outward form, a material expression may be continuous whereas the concepts which it embodies may 
drastically change. In earlier articles in this series Dr David and I have tried to emphasize that, although 
the instruments of gaming had existed for several thousand years, probability theory as a conceptual 
abstraction of the laws of chance did not come into being until the sixteenth century. In this present note 
I want to stress the fact that something of the same kind is true of what we call ‘statistics’. 


3. The temptation to begin a history of statistics with references to endeavours in the ancient world to 
record information about states is one which no writer has been able to resist. The numbering of the 
people of Israel, Augustus’s balance sheets of the Roman Empire, Charlemagne’s inventory of his 
possessions, the Doomsday book, are felt to be a natural preliminary to the emergence of descriptive 
statistics in the eighteenth century; as though they were early attempts undertaken in the spirit of 
modern statistics, hampered by the backward state of social organization, but inspired by the same 
concepts. 

4. To believe this, in my opinion, is to fail to understand either the basis of the statistical approach or 
the nature of the statistical method. In this note I put forward the thesis that statistics as we now under- 
stand the term did not commence until the seventeenth century, and then not in the field of ‘statistics’. 

5. The early inventories, of which the Doomsday book is an outstanding example, were not, of 
course, called statistical. The first use of the word known to me occurs in a work by an Italian historian 
Girolamo Ghilini, who in 1589 refers to an account of the civile, politica, statistica e militare scienza. From 
then onwards we have aseries of well-known landmarks in the history of political description: Sansovino’s 
(1561) Dal governo ed amministrazione dei diversi regie e republiche; Botero’s (1650) Le relazione universale; 
Seckendorf’s (1656) Teutscher Fiirstenstaat; Oldenburger’s (1673) publication of Conring’s lectures; 
Anchersen’s (1741) Statwum Cultiorum in Tabulis; Siissmilch’s (1741) Géttliche Ordnung; Achenwall’s 
(1748) Public Dissertation; Biisching’s (1754) Neue Erdbeschreibung. These works are often referred to as 
‘statistical’ and their authors used the word to denote the method of their studies. But they are entirely 
concerned with the description of political states and any numerical information in them appears by 
accident or convenience. They are the forerunners of our geographical and political works of reference 
like The Statesman’s Y earbook, containing an immense amount of interesting information, but ‘statistical’ 
only in the sense of relating to what the Germans called Staatenkunde. The point has been well made by 
Westergaard (1932) in his modest and scholarly history. If it were not, he says, for the fact that the same 
word ‘statistics’ is used to denote both this early work and statistics in the modern sense, the student of 
the latter would probably pay no attention to the former; and Westergaard implies that he would lose 
little by ignoring it, a judgment with which I agree. The true ancestor of modern statistics is not 
seventeenth-century statistics but Political Arithmetic. 

6. There is another reason, of quite a different kind, for not seeking the origins of modern statistics too 
curiously among the ruins of the medieval world. The early inventories of the Doomsday type were 
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pictures of a stationary state of society. ‘The feudal state of the Middle Ages’, says Burckhardt (1929), 
‘knew of nothing more than categories of signorial rights and possessions. It looked upon production as 
a fixed quantity, which it approximately is, so long as we have to do with landed property only’. In 
those days the world was a small affair, only a few thousand years old, the fixed centre of the universe, 
guided under a rigid set of rules by state and church. There was no particular point in trying to keep track 
of minor changes in such a system. The main motives for statistical inquiry, the estimation of military 
man-power and of taxation revenue, were absent. Not that soldiers and taxes were unimportant, 
but that the state’s resources could be estimated simply on the basis of what had resulted from the 
last levy. 

7. For the dissolution of this system we look naturally to those states which first began to found their 
economy in trade and manufacture; and we find, accordingly, that in fourteenth- and fifteenth-century 
Italy statistics in the sense of political arithmetic began to emerge. There are statistical accounts of some 
of the Italian city-states as early as the thirteenth century—there have survived accounts of Asti in 
A.D. 1250 and of Milan in a.p. 1288. But these are inventories, although greater emphasis on goods, shops 
and persons is already noticeable. To Venice, apparently, goes the honour of priority in a new approach. 
It was the Venetians who first counted the population as souls, that is to say, included all living individuals 
and did not, for example, confine themselves to citizens who were capable of bearing arms or paying 
taxes. It was at Venice on one occasion, too, that a proposal to go to war with a neighbouring state was 
rejected on the economic grounds that fighting the customer was bad for both sides. This general interest 
in numerical assessment was echoed at Florence and, a little later, among some of the despotisms of 
northern Italy. 

8. Bearing in mind then, that fifteenth-century Italy saw striking developments in accountancy and 
mathematics, and hence that the necessary technical equipment was available we may conclude that the 
commercial requirements of the age alone necessitated the collection of a great deal of material which 
would nowadays be called descriptive statistics. But we are, I think, still short of a statistical approach. 
Counting was by complete enumeration and still tended to be a record of a situation rather than a basis 
for estimation or prediction in an expanding economy. In any case the Risorgimento occurred too soon 
for a Europe which was to spend many years fighting destructive wars at home and colonizing an unknown 
continent abroad. There appears to have been very little accomplished outside Italy either in descriptive 
statistics or in probability in the sixteenth century. Not until Europe had settled down about the time of 
our own restoration (A.D. 1660) did political arithmetic (including life assurance) begin in earnest. 

9. Progress was then rapid, and as in many scientific developments, the basic ideas seem to arise 
independently at many points in Western Europe. John Graunt’s famous Observations appeared in 1662. 
Hudde’s book on Annuities appeared in 1671. Ludwig Huyghens writes to his brother Christian in 1669: 
‘I have just been making a table showing how long people of given age have to live. . ..Live well! 
According to my calculations you will live to be about 564 and I to 55.’ At the close of the century we 
have, within a few years, Petty’s Political Arithmetic (1690), Halley’s Estimate (1693), Gregory King’s 
Observations (1696), Davenant’s Discourses on the Public Revenues (1698) and, in 1703, the first census of 
modern times, in Iceland. There are many accounts of this work, especially of Graunt’s and Petty’s. 
Anyone who reads Graunt or King must, in my view, feel that this is the point at which statistics 
really began. The whole attack on the problems can be appreciated by a statistician or a demographer 
nowadays. These men, one feels, thought as we think today, with most imperfect material but with 
enviable penetration. They reasoned about their data. 

10. This is not to imply that statistics in the old sense came suddenly to an end, or that the inferential 
type of approach spread from demographic applications to other fields with any speed. The political 
description of states continued and flourished, becoming more numerical as additional data were col- 
lected, but remaining essentially the systematic collection of facts. During the eighteenth century we 
find the two subjects running side by side with very little apparent connexion between them. In the one, 
enumerative surveys such as Ninclair’s (1793) Statistical Account of Scotland, and discourses by men such 
as Wargentin, Biisching and Schléger, whose very names are unknown to modern statistics; in the other, 
contributions to demography and actuarial science by men such as Demoivre, Daniel Bernoulli, Laplace, 

uler and Poisson. It was not until the middle of the nineteenth century that these two branches of 
knowledge showed any sign of coalescence. 

11. I conclude then, that statistics in any sense akin to our own cannot be traced back before about 
A.D. 1660. To look backwards from that point is interesting but can be misleading, unless its purpose is, not 
to show that modern statistical ideas can be traced back into medieval and ancient times, but that such 
ideas were almost unknown prior to a.p. 1660. There are new things under the sun and the attitude of 
mind towards experimental knowledge about natural and social phenomena which flourished after the 
Restoration is one of them. 
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On the number of renewals in a random interval 


By D. R. COX 
Birkbeck College, London 


1. INTRODUCTION 


There have been many studies of the number N, of renewals occurring in a fixed time interval (0, ¢) 
of a renewal process; see especially Feller (1957, Chapter 13) and Smith (1958, 1959). Suppose, however, 
that we are interested in the number N of renewals in an interval (0, 7'), where T is a random variable 
distributed independently of the renewal process. For example, 7’ may be the lifetime of a whole piece 
of equipment, and we may be concerned with the number of component replacements that are necessary 
during 7’. 

The object of this note is to point out that when the distribution of T' is of the gamma type, the pro- 
perties of N can be found without the inversion of Laplace transforms. Processes in continuous time 
only are considered. 


2. FORMULATION OF PROBLEM 


A renewal process is defined by a sequence (X,, X9, ...) of independent identically distributed random 
variables, taking only positive values, and assumed here to have a continuous distribution with prob- 
ability density function (p.d.f.) f(w). The random variable X; can be interpreted as the lifetime of the 
ith component, so that renewals occur at times 


X,,X1+Xzq,.... (1) 
The random variable N, is defined as the number of renewals in (0, ¢), i.e. formally as the number of 
partial sums (1) in the interval (0,¢). One of the especial interests of renewal processes is that they arise 


not only in connexion with the renewal of components, but also in a wide range of problems of applied 
probability theory (Smith, 1958). 


If p,(t) = prob (N, = r) (2) 
and G(z,t) = s 2"p,(t), (3) 
r=0 


then it is known that the Laplace transforms of these functions are 


1—f* 
pile) = Ur —_™, (4) 


__ 1-f*(s)_ 
OOO ga aFt0)) ” 


Here the asterisk denotes a Laplace transform with respect to ¢, so that, for example, 


f*(s) = f ” ep (t) dt. 
0 


From (5) the Laplace transform of the mean, and more generally of the factorial moments of N,, 
can be found by differentiating with respect to zat z = 1. Alternatively, and more neatly, the 6-moments 
of Smith (1959) are defined by 


Pt) = E[(N,+1)(N,+2)...(N,+7)], (6) 


and for these we have the simple formula that 


Or (s) = (7) 


pes. We 
(1-f*(s))" 
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In general the explicit inversion of these results into usable formulae for p,(t) and G(z, t) is possible only 
for special f(x). Simple general results are, however, available for large ¢. The asymptotic normality of 
N, was proved by Feller (1957, Chapter 13) and Smith (1959) has shown under weak assumptions that 
the rth cumulant of N;, has, for large t, the form 


a,t +b,+0(1) (8) 
and has given a,, b, (r < 8) in terms of the moments of the X’s. 

Now suppose that the positive random variable T is distributed independently of (X,, X., ...) and has 
p.d.f. g(t). Let N be the number of renewals in (0, 7’). Then the probability generating function of N is 
given by 


Gz) = 2X Pre = I. G(z, t) g(t) dt. (9) 


We consider here how this can be obtained without inverting the Laplace transform (5). 


3. A GAMMA DISTRIBUTION FOR 7' 


We now suppose that the p.d.f. g(t) is of the T type, or more generally is a weighted sum of terms of 
the I type. Take for q(t) the special form 
(k/m)* t#-1 e-Ktlm 


Ix, m(t) = (k—1)! “9 (10) 
where m is the mean of 7' and the coefficient of variation of T' is 1/,/k. 
Now * 
G*(z,8) = G(z, t) e-**dt, 
0 
o\*1 fo) 
so that (-5) G*(z,s) = i) G(z, t) #1 e-stdt. (11) 
0 


This is immediate for integral k; to justify the formula for general k we can interpret (— 2/@s)*-1 by using 
fractional derivatives in the sense of Liouville; see, for example, Courant (1946, p. 339). 
It follows from (11) that 


G(z) = I Gz, t) Vx, m(t) dt 
0 
k k o\*-1 
= GRE (- 5) (9 eNaam (12) 


_ (k/my* = gee: ie 


~ (k—1)!\ és 8(1—2f*(8)) Jeozim 
By extracting the coefficient of z’, or by arguing directly from (4), we have that p,, the probability that 
N >i 
equals r, is _ (kim) “ [* —f *(s) (f *(s))" (14) 
y= (k—1)! és 8 o=ne 


The general result is that if w(t) is a function of t, then w; ,, the average of w(t) with respect to the 
p-d.f. g% m(t) is given by (k/m)* a 


k-1 
Wzm = (k-1)! ) [w*(8)],—x/m: (15) 


~ €8 
An interesting special case is obtained by letting k > oo. Then the gamma distribution (10) tends to the 
point concentration of probability at m, and therefore w,, ,, tends to w(m). If we replace m by t, we have 


that (kjey* (-g 


k-1 
w(t) = lim 5) [w*(8)],—nits (16) 


k>o (k—1)! 


an inversion formula for the Laplace transform due to Post (1930). 


4. SOME SPECIAL CASES 


The evaluation of (13) and (14) is easiest when k is a small integer, that is when T is distributed 
proportionally to chi-squared with a small even number of degrees of freedom, a so-called Erlangian 
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distribution. In particular if T' is exponentially distributed, k = 1, and then 


1—f*(1/m) 
1—2f *(1/m)’ 
so that the distribution of N is geometric with mean f *(1/m)/(1—f *(1/m)). If m is large and if only the 
low-order moments of the X’s are known, f *(1/m) can be approximated by expansion in series. The 
intuitive explanation of the occurrence of a geometric distribution. is as follows. Consider a Poisson 
process of rate 1/m producing events called ‘catastrophes’. The probability that a lifetime X,; contains 
no catastrophe is easily shown to be f *(1/m), the probabilities for different X; being independent. The 
random variable N can thus be interpreted as the number of lifetimes that are completed before a cata- 
strophe, and has the form of the number of ‘failures’ recorded before the first ‘success’. The application 
of a similar idea to interpret other equations in renewal theory has been outlined by Cox (1957). 

The result (17) generalizes simply if the distribution of T is a linear combination of exponential terms; 
such a combination is sometimes useful, for exampls, to represent a distribution with coefficient of 
variation greater than one. 

If the distribution of the X’s also is of the gamma type, with p.d.f. 


(x /js)¥ ak-1 @-e2ip 


G(z) = (17) 





(k-1)! ’ ve 
then f*(s) = (1+ p8/x)-* 
_ (kim)t (_ 8\¥* 7 (1+p8/x)*- 
and ~~ (k—1)! (-3) Pea + ps/K)K — aka’ 4 


In this formula the symbols k, m refer to the distribution of 7’, whereas xk, 4 are the corresponding para- 
meters of the distribution of the X’s. 

If x = 1 the renewals form a Poisson process and (19) then gives 

(kum) 

(1+ky/m—z)’ 
a negative binomial distribution. This result is equivalent to the standard result that a Poisson distribu- 
tion compounded with a gamma distribution leads to a negative binomial distribution. For, given the 
value of T' = t, say, N; has a Poisson distribution with mean jt, and (20) gives the distribution of N when 
T, and hence 7’, follows a gamma distribution. 


lfk=x=2 

(4/m)* (/m + 3) (u/m + 1) (u/m)Pz 
((1+4/m)?—z}? [(1+p/m)?—2}” 
so that the distribution of N is a weighted sum of a negative binomial distribution of index two and of the 
same distribution with all the variate-values increased by one. In a particular numerical application, 
(19) can be used to obtain the distribution of N provided k and x are not large; if the small values of N are 


of particular interest, it may be easier to work from (14). 
For the ¢-moments of N, we have from (7) and (15) that 


¢, = E[(N +1)(N+2)...(N+r)] 


~em(-a)” [afr] 
~ (k-1)!\ ds (1—f *(8))”_Joekim. 


and in particular, if f (2) is given by (18), 


G(z) = (20) 


G(z) = 





(21) 








¢, = E(N+1) 
= (k/m)* (-5) (1 + ps/K)* | (22) 
~ (k-1)!\ ds (1+ ys/K)*—1 Jeceim 


from which explicit expressions can again be obtained, especially if k is a small integer. If m is large and 
k small, all the values of 7' will be large, and the following special cases of (8) can be used 


E(N,|t) = -+(4- ) +o), 


be— HG 5uZ 2s fe ) 
N,|t) = ——* t+ | -—— -— 1), 
V(N,|t) a +(2 3u° 2y,) tC) 
where 1, is the rth moment of the X’s about the origin and yp, = p. 
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Then EIN) = + (£ A 1) +0(1), (23) 
& \2p8 





V(N) = eam mt (= 2s ee) tou. (24) 


pe kt \aut 3p? 2p? 


5. EQUILIBRIUM RENEWAL PROCESS 


The results above apply to a renewal process in which the time-origin is the start of the life of a com- 
ponent, i.e. in which the random variable X, has the same distribution as the other X’s. In applications it 
often happens that X, has a different distribution from the other X’s, and an important special case is 
the so-called equilibrium renewal process (Cox & Smith, 1954) in which X, has the p.d_f. 


{1 [" seman /n (25) 


this corresponds to a system in which the process has been running for a long time before the time-origin. 
If N, is the number of renewals in (0, ¢) and G,(z, t) its probability generating function, then analogously 


to (5 
” Qt _1 (1-f*(s)) (1-2) 
#(z,8) = ——- 
8 s%(1—2f *(s)) 
and the previous arguments apply. In particular if 7 has an exponential distribution, the result analogous 
to (17) is that 
ssi _(-2(1-F*(1/m) 


(1-2 *(1/m) 


(26) 


G,(z) = 1 





(27) 
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A note on sufficiency in regular Markov chains 


By B. R. BHAT anv J. GANIf 
University of California, Berkeley and University of Western Australia, Nedlands 
1. INTRODUCTION AND SUMMARY 


For positively regular (p.r.) Markov chains with a finite number s of states and transition probabilities 
Pil) (t,7 = 1, 2,...,8) defined by an unknown parameter 0, Gani (1955, 1956) has shown that in realiza- 
tions starting from a fixed state Z, (a = 1, 2,...,8) the form of the p,,(0) admitting a sufficient estimator 


of @ is 
Pis(9) = Ay exp {Kj Ay(9) +A,(9)}, (1-1) 
8 
where the A,;, K,; are constants. Since }) p,,() = 1 for all rowsi = 1, 2,..., 8, it follows that for every 7 
j=1 

8 
exp {—A,(9)} = 2 Auexp {Ki,A,(9)}; (1-2) 

j= 


this means that there can exist only r < s distinct exponents K,, such that apart from coefficients A;;, 
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the p;,(9) in each row of the stochastic matrix consist of the same r < s distinct forms of type (1-1) in 
varying orders. 

In this note, the initial state Z, is random, and a slightly more general result is obtained for p.r. chains 
with initial probabilities a,(@) and transition probabilities p;,(9) (a, i,j = 1, 2,...,8). Aspecial regular (r.) 
but not p.r. chain is also considered, and some properties and distributions of the sufficient estimators of 
@ in both p.r. and r. chains are given. 


2. THE P.R. MARKOV CHAIN 


Let S be a realization of n transitions, starting with a random state H,, froma p.r. Markov chain whose 
initial and transition probabilities are a,(), p;;(0) (a,7,7 = 1, 2,...,8), respectively. For sucha realization 
the log-likelihood function is given by 


8 8 
L(S) = X %alna,(9) +. D> a In p;;(9), (2-1) 
= i,j= 
where each x, may be 0 or 1 but 
8 
eae 
a=1 
and the n,; are transition frequencies such that 
s 
>» nyz=n. 


i,j=1 


Let T(x, n) be a sufficient estimator of 0, where x, n indicate the elements {x,} and {n,;}; the factorizability 
condition then leads to the equation 
L(S) = f(x,n)+ F(T, 0; x,n), (2-2) 


both x and n being constants which may (but need not necessarily) appear explicitly in L(S). 
Assuming differentiability with respect to 0 for all a,(0), »;,(0), it follows from (2°1) and (2-2) that 


8 8 
oF /00 = G(T,0;2,n) = > x, d{lna,(9)}/d0+ > n,;d{Inp;,(9)}/dd, (2-3) 
a=1 i,j= 
where G is a linear function of the {x,} and {n,,;}. For 2 and n to appear explicitly in (2-3), we must have 
d{ina,(9)}/d0 = u,(0)+u(A), 
dln p;,()}/d0 = w;,,(8) + w(9), 
the function G then being of the form 


(a, 4,7 = 1,2,...,8) (2-4) 


G(T, 9; x,n) = > Ly Uq(O) + xu(O) + > N43 W;(9) + nw(9). (2-5) 
a=1 i,j=1 


Although the {x,}, {n,;} are discrete, the function G is formally differentiable with respect to each x,, 


n;; as well as x, n; if we further assume that T is differentiable with respect to the {x,}, ,{n,;}, we readily 
wees u,(0) = {2G/0T} {eT /ax,}, i 
(a,4,9 = 1,2,...,8). (2-6) 

w,(0) = {0G /0T} {eT /on,,}, 


From this, it follows that @T'/éx, and 2T'/én,; must necessarily be functions U71(T), W51(T) of T, 
respectively, not depending on x, and n,;. This means that 


0G /eT = u,(0) U(T) = w;,,(9)Wi(T) («7,7 = 1,2,...,8), (2-7) 
and this will hold only if for all «,7,7 = 1, 2,...,8, 
u,(9) Kz} = w;,;(0) K5* = kA), 


(2-8) 
UT) K, = W,,(T) Kj; = oT), 


where the K,, K,; are constants. 
Integration of (2-4) leads directly to the exponential forms for the initial and transition probabilities 


a,(0) = A, exp {K, A,(9) + A,(9)}, 
Pis(9) = Aj; exp {K,; Ay(9) +A(9)}, 


(a, %,7 = 1,2,...,8), (2-9) 
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where A,, A;; are constants, and A,(@) = Se) d@; itshould be noted that the functions A,(@) = fu(a)ae 
and A,(@) = f(a) d(@) are distinct. Since the form of the p,;,(0) is identical with (1-1), this clearly leads to 


a similar matrix configuration for the transition probabilities. It is obvious that since > a,(0) = 1, then 


a=1 

8 
exp {—A,(0)} = x Aa exp {K, A,(9)}. (2-10) 

The function G is given by wid 
G(T,0; x,n) = k(O) 9(T) +xu(O) +nw(9), (2-11) 

where (7) = fot) aT is 
g(T) = for: > (6T' /éx,,) da, + > (8T'/On;;) dnj;} = 2 vy K, ~ > Nis Ky; (2-12) 
i,j= i,j=1 


a linear function of the x, and ;;. 


3. A SPECIAL R. MARKOV CHAIN 


Consider now the r. Markov chain with s+1 states whose initial and transition probabilities are 
a,(9), pi(9) (x, 7,7 = 0, 1,...,8), respectively, but such that a,(0) = 0 and p9(4) = 1, the state 0 being the 
only absorbing state in the chain. If S’ is a realization in n + 1 transitions from such a chain (n now being 
a random variable) starting from a random state a = 1, 2,...,8, the log-likelihood function is given by 


8 8 
L(s’) = > wglna,(0)+  nylnpy(9)+ ¥ vslnppel0) (3-1) 
i,j= f=1 


where each x, and yg may be 0 or 1 but > vy, = «= 1 and 2, Ye = y = 1, the n,; being transition 
a=1 
frequencies such that > Ny =n. 


i,j= 
Let T(x,n,y) be a sufficient estimator of 0, where x,n,y represent the elements {x,}, {ni;}, {yg}, 
respectively. The factorizability condition for sufficiency will then give 


L(S’) = f(x,n,y) + F(T, 9; x,y), (3-2) 


both x and y being constants which may appear explicitly in L(S’). It should be noted that in contrast 
with (2-2), n which is now a random variable does not appear in the function F. 
It follows, exactly as in § 2, that 


oF /00 = G(T, 6; x,y) = 2 Way Ug (9) + cu(O) + > 143 Wis(9) + z Yara) +99), (3-3) 


i,j= 
where d{lna,(9)}/d@ = u,(0) + u() bal d{ln pgo(9)}/d0 = vg(9) + (9), but ia pis(9)}/dO = w,,(9) only, for 
a, f,i,7 = 1,2,...,8. Following some analysis similar to that in § 2, it is readily found that 


a,(9) = A, exp{K, A,(9)} + A,(9), 
Pif9) = Ay exp {K;;A,(9)}, (a, £,i,j = 1,2,...,8), (3-4) 
Ppl) = Bgexp{M, A,(9) + V,(9)}, 
where as before A,(™) = fk(0) a0 and A,(9) = fu) ae, while V,(0) = fev) dé. 
We now show that since E pul?) = | for each i = 1,...,8, all pgo(9) (2 = 1,...,8) must be identical. 


For consider the two rows 7, and 7,; then clearly for these 


8 8 
b-; -¥ 140) / B,, exp {M,, A,(6)} = b- -¥ E70) / B,, exp {M,,A,(0)} = exp V8) 


for all wiees of @. Equating the single positive terms in each expression, we obtain that B, = B,, and 
M;, = = M;, , so that all 


Ppl) = 1— % vy(O) = fl) (B= s---08) (3-5) 


are identical. It is convenient to write these as f,(9) = exp V,(0) where By = = 1 and M, = 0. Thus, 
exactly as for the p.r. chain, there exist only r < s distinct exponents K;,; (i,7 = 1,...,8) pa. that apart 
from coefficients A ,; the p,,(9) other than p,, in each row of the stochastic matrix consist of the samer < 8 
distinct forms of type (3-4) in varying orders. 
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Lastly, the function G is given by 
G(T, 0; x,y) = k(A) oT’) +xu(9) + yr(9), (3-6) 


where g(T) = 3: XK, + S 14; Ki; (3-7) 
i,j= bos 
precisely as in (2-12). 
4. UNBIASEDNESS AND MINIMUM VARIANCE PROPERTIES 


In distributions admitting a sufficient statistic, the estimator is known to have properties of unbiased- 
ness and minimum variance (Rao, 1949). For id p.r. Markov chain of §2, the distribution of the x, and 


n,; in a realization with a fixed number n = > n,; of transitions is 
i,j=1 


8 
P(S) = cexp| > «7, K, 9+ A(9)+ > 143K y9+nA,(O) + > vIn A, + > nyln Ag}, (41) 
a=1 i,j=1 i,j= =1 


where we have written 0 for A,(9) for simplicity, and C is some constant. 
Now carrying out the summation 2’ of P(S) in (4-1) over all possible values of the n,; starting with 


8 
state a and such that >) n,; = n remains fixed, and then over all states ~, we obtain 
i,j=1 


2 PIs) =1. (4-2) 


It follows readily on differentiating with respect to 0 that 


B( 3 2aKet B nuKu) = —(0A(0)+A40), (4:3) 


i,j=1 
so that g(7') = 2 L,Ky+ 2," ni;K,; is an unbiased estimator of —{nA,(@)+A,(A)}. A second 
differentiation of ( (4: 2) with sanaek to 6 gives the (minimum) variance of g(7') as 
H(g(T)) = — {ndAj(A) + AZ(9)}. (4-4) 


In a similar manner, the distribution of the x,, n,; in the r. Markov chain of §3 for a realization with 


8 
a random number n+ 1 of transitions, wheren = )) 1,; is given by 
i,j=1 
P(S’) = Cexp 2, L,K,0+ A,(9) + s 14; K,0+ V(0)+ 2 tn A,+ > nyln Au, (4:5) 
i,j=1 a j= 1 


where A,(9) is again written 0 for simplicity, and C is a constant. 
Summing over all possible n,; for a fixed value n, then over all n = 0,1,..., and finally over all a, we 
have that 
> > >Y’P(Ss’) = 1, (4-6) 


a=l1n=0 


and as before, differentiation with respect to 0 gives 


23 a,Ky+ yn Ku) = —{A,(0) + Vi(0)}. (4-7) 
i,j=1 
so that g(T) = >» ty Kat Dn 143 Ky; 
4,j=1 


is an unbiased estimator of —{A,(9) + 740). Its (minimum) variance is 
D(g(T)) = —{AG(A) + V4(9)}. (4-8) 


5. DISTRIBUTIONS OF THE SUFFICIENT ESTIMATORS 
Let ¢(t) be the characteristic function (c.f.) 
P(t) = E(etta?) 
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of the sufficient estimators 


8 8 
y(T) = X taker | LD rg Kiy 
a 


i,j=1 
in both the cases considered. We continue to write 6 for A,(@). 
For the p.r. Markov chain of §2, we have from (4-1) that 


P(t) = DX’ Cexp {(6+ tt) (Yax,K,+ LnsKu) +A,(9) +nA,(9) + x_n A, + Ynyln Aj;} 
a a i, a i,j 
= exp {A,(@) + nA,(9) — A,(0 + it) —ndA,(8 + it)} (5:2) 
as a result of (4:2). This may readily be rewritten as 


P(t) = LA, exp {K,(9 + it) + Ax(9)} (LL A,; exp {K,,(8 + it) — A,(9)})" 
a j 
= =@,(9) exp {iK, 0 (Xi Prs(9) exp {tK,;t})", (5-3) 
a j 


a form similar to the c.f. for a multinomial distribution. The asymptotic normality of the estimator as 
n — © follows readily. 
For the r. Markov chain of §3, we have from (4-5) that 


A(t) = YD D/C exp {(0 + it) (Le Ky + YD ris Kis) + Ag(9) + V(9)+ De, mA, + Ynjn Aj} 
an a i,j a i,j 


= exp {A,(9) + V.(0) —A,(9 + it) — V(0 + %t)} (5-4) 
as a result of (4-6). This may be rewritten as 
P(t) = fo(9) {fo(O + it)}-* Da, (8) exp {iK, t}. (5:5) 
a 


It is interesting to note that (5-5) depends on the initial probabilities and f,(0) only. If m distinct 
realizations are taken, the c.f. will be ¢”(¢), and again as m —> oo, the estimator is readily shown to be 
asymptotically normal (cf. Bhat, 1959). 

We illustrate the previous results briefly in tl.e following examples. 


Example 1. If in the p.r. Markov chain, the transition probabilities in a particular row i of the 
stochastic matrix are binomial, so that for 0 < 0 


pi) = (‘) e(1—e)-3 (7 = 1,2,...,8) (5-6) 
and the remaining rows are varying permutations of these, then 
#0) = Daw) exp (iK,4 (3 (5) ror eyes) 
= Ya,(0) exp {iK;t} teasing. (5-7) 
r 


so that the distribution of the estimator g(T7') is the convolution of the initial probability distribution 
with a binomial distribution. 


Example 2. Let all the K;,; in the r. Markov chain be constants equal to unity (say), then 


WT) = Sx,Ky+n 


i=1 


is a sufficient estimator of 8. Now for any row r = l,...,8, we have that 


8 
fol + it) = 1— SY A,,e0+80 
j=l 


= 1-ett > A,,e? = 1—e*(1—f,(0)). (5:8) 
j=1 
It follows that (5) reduces to " 
P(t) = fo(9) {1 —e(1 —f.(9))}* Y a, (9) exp {iK, 4}, (5-9) 


so that the distribution of the sufficient estimator g(T7’) is the convolution of the initial probability with 
a geometric distribution (cf. Bhat, 1959). 
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The regression of true value on estimated value 


By R. N. CURNOW 
A.R.C. Unit of Statistics, University of Aberdeen, Aberdeen, Scotland* 


1. INTRODUCTION AND SUMMARY 


Selection has often to be based on the estimated values of a certain character rather than on the true 
values of that character. Examples abound in plant and animal breeding work and also, for example, in 
selection based on estimated 1.Q. scores. The effect of the selection on the mean estimated value can be 
readily calculated. The effect of the selection on the mean true value is clearly of much greater importance 
and its calculation requires a knowledge of the regression of true value on estimated value. 

We shall assume that the true value, x, is estimated by y, where 


y= xr+u, 


with w normally distributc.d independently of x with zero mean and variance ¢?. We shall further assume 
that x is distributed continuously over the population subjected to selection with frequency function 
f(x). All the integrations with respect to x can be replaced by summations to show that the results also 
apply when z has a discrete distribution. The joint frequency function of x and y is 


fey) = fle) (=) ' 


where d(z) = oa exp { — 32°}. 


: [ ¥ xf (x) 6“) dx 

h(y) = E(x\y) = —— : 
1 ft i 

[ neo(%*) dix 


7... 


Therefore the regression of x on y is 





If selection improves the average value of y by an amount Ay, then the expected value of the corre- 
sponding increase in the average value of x will be 


Ax = h(y+Ay)—h(y). 
If x is normally distributed with mean pu and variance o, the function h{y) is known to be 


h a 
(y) = B+ al) 
o2 


Therefore, Ax = —— 
o* +6 


Ay. 

Lindley (1947) showed that the necessary and sufficient condition for x to regress linearly on y is that 
the cumulant generating function of the distribution of x be a multiple of the cumulant generating 
function of the distribution of w. As an example, he showed that the regression is linear if x and 
w have independent y? distributions. We shall show that when w is normally distributed, the form of the 


* This work was completed while the author was visiting Iowa State University on a Harkness 
Fellowship of the Commonwealth Fund. 
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regression always completely determines the distribution of x. Lindley’s theorem and this last result 
have a special case in common—when w is normally distributed linearity of regression implies a normal 
distribution of x. 

A linear regression of true value on estimated value is often assumed in the calculation of the conse- 
quences of selection. Few writers known to the author have stated that, if the errors are normally 
distributed, this involves an assumption of normality for the distribution of true values. Departures 
from normality in the error distribution may increase or decrease the non-linearity of the regression 
depending on the distribution of x. For example, if 2 and w both happen to have x? distributions the 
regression will be exactly linear. Clearly, small increases in the expected mean value of z will be approxi- 
mately linearly related to small increases in the mean value of y whatever the distribution of x. However, 
even in this case, the actual value of the regression coefficient, i.e. the rate of increase of x with y, will be a 
function of y and only exceptionally the same as that calculated assuming normality. The functions h(y) 
will be given for certain non-normal distributions of x. 


2. DERIVATION OF f(%) GIVEN h(y) 





ee uly) = = ) °° fle) o(%*) dx 
and oy) = =f. f(x 4% *) ae, 
u(y) 
we have that h(y) = oy) : 
+00 
Now, differentiating v(y), a = -5] wes) =) —— f(x “(= 1") ae 


1 
= 5 luly)-y)] 


-w 
—; [A(y)—y)- 
H = 2 
The solution of this equation is v(y) = cexp (awe 7 
vy 
where H(y) = | h(z)dz and cis an arbitrary constant. Now v(y) is the frequency function of the distribu- 


tion of y and therefore the characteristic function is 


#lt) = 0 [exp [EU ay, 


Finally, we know that x and w are independently distributed and therefore that the characteristic 
function of the distribution of x is 


Palt) = Py(t)/Pwlt) 


coal ea [oes ppawa bes +iyte?) 5 


The constant ¢ is chosen so that ¢,(0) = 1. Since a frequency function is uniquely determined by its 
characteristic function, this completes the proof that the regression of x on y completely determines the 
distribution of «. The converse, that the distribution of x completely determines the regression of x on y, 
is obviously true. Since ¢,(t) has to satisfy certain conditions to be a characteristic function, not every 
function h(y) is a possible regression function. 


Since d +0 
ee ;- wf (x (2 Y=") ae muy) | 


du(y) 


and “dy =— aluy)— yr(y)), 


—_—- oo: OO eee ere 





an 


an 


If 
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dy u(y) dy = vy) dy 
ae exe y-2 
“a m2 J PR (2) ae— my) | 
1 
= 4 (Bley) - [Eel 


variance of x for given y 
= - 2 





Therefore, we have also shown that, given the mean of x, the distribution of x is completely determined 
once the dependence of the variance of x for given y on y is known. More importantly, perhaps, this shows 
that if selection increases y by asmall amount from yp to y¥, + Ayo, then the corresponding increase in x will 
be approximately 


variance of x when y = yp 
Az = - 
€2 





Ayo: 


3. SoME SPECIAL CASES 
If h(y) is linear, then 2 is normally distributed. This follows immediately by writing 
h(y) = a+b(y—a) 


and, therefore, HA(y) = ay+4b(y—a)*. 
Substituting in the expression for ¢,(¢) and integrating, 
; e*bt? 
¢,(t) = exp {aie 2(1—b) . 


Therefore x is normally distributed with mean a and variance be?/(1—b). In the previous notation a = yu 
and 6 = o?/(o? +e?). 

The functions h(y) can be written in terms of well-tabulated functions for certain distributions of x. 
For example, if x has a rectangular distribution between « = 0 and x = 1, 


ots) 
rere 


where O(z) = ;. (a) da. 








h(y) =y—e 


Ifz has a y? distribution with v degrees of freedom, 
hy) = 


where Hh, are the Hermitian Probability Functions tabulated for integral values of n in the British 
Association Mathematical Tables (1951). If x is distributed as ,/y?, where x” has v degrees of freedom, then 


y 
- m,(-—* —) 


a) 
ey(1 +e) 





hy) = 


With appropriate changes in the scale and origin of y and h(y), the function h(y) for vy? with 2v degrees of 
freedom is the same as the function h(y) for ,/y? where x? has v degrees of freedom. This does not contradict 
the theorem above that the regression uniquely determines the distribution of x. For distributions such 
as these in which the range of possible values of x does not extend from — co to + 00, a linear regression of 
x on y over the whole range of values of y is obviously impossible. 


29 Biom. 47 
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The magnitude of the deviations from linearity will clearly depend on the ratio, ¢?/o?, of error variance 
to population variance, the extent of the departure from normality in the distribution of x and the 
intensity of the selection. When selection is aimed at increasing the value of a character that has a definite 
upper limit, and that upper limit has nearly been reached, then the regression is likely to be far from 
linear. This will occur, for example, in selection from rectangular and ‘reversed’ y? and y distributions. 
The regression function tor the ‘reversed’ distribution [i.e. the distribution with frequency function equal 
to f(—2) instead of f(x) (see Curnow, 1958)] is obtained from h(y), the regression function for the original 
distribution, as —h(—y). 


I am grateful to Dr D. J. Finney and Prof. O. Kempthorne for suggesting improvements in the 
presentation of this paper. 
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The use of integral transforms to determine expansions of distribution functions 


By W. M. HARPER anp J. A. MACDONALD 
Australian Defence Scientific Service, Defence Standards Laboratories, Maribyrnong, Victoria, Australia 


1. IntTRODUCTION 


For many variates, the evaluation of probability points is extremely tedious. In the case of the 

quadratic form 

x = XA,u?, 
for example, where the u,; are independent standard normal variates and the A; are constants, many 
methods which might be used to determine the distribution have been devised including among others 
those given by Robbins & Pitman (1949), Grad & Solomon (1955), Gurland (1955, 1957) and Daniels 
(1956). The usefulness of these methods, however, is markedly affected by the values and multiplicities 
of the A,. 

If the characteristic function of the variate can be obtained, some integral transforms of the distribu- 
tion function are easily derived. The transforms considered here are the Fourier and Laplace transforms, 
the latter being more convenient for variates which are always of the same sign. 

Under certain conditions it is then possible to obtain expansions from which probability points in both 
tails of the probability distribution curve can be evaluated. The procedure appears to be useful for 
dealing with some quadratic forms where other methods are unsuitable or inconvenient. 

Although in this paper emphasis is placed on statistical distributions, the expansions have other 
applications in analysis (see, for example, Watson (1945), Jeffreys & Jeffreys (1946), Carslaw & Jaeger 
(1948)). 


2. EXPANSIONS FOR THE DISTRIBUTION FUNCTION 


In order to ensure convergence at infinity of the Fourier integral used in the following analysis, a 
‘modified distribution function’ is defined by 


£ 
R(x) = H(z) -{ f(y) dy, 
ie) 
where H(x) is Heaviside’s unit function and f(z) the probability density function of the variate 2, i.e. 


HA(x)=0, R(x) = —P(zx) (x < 0), 
H(x)=1, R(x) =1-—P(x) = Q(x) («> 0), 


where P(x) is the distribution function. 
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In terms of the characteristic function ¢(¢), the Fourier transform p(t) of R(x) is given by 
‘ec 
p(t) = i) e@"*R(x) dx 
—o 
= (it) {9() — I, 


by partial integration. The Fourier inversion formula becomes 


i f@ : 
R(x) = =f e-*#! p(t) dt. (1) 


As remarked above, for positive variates it is more convenient to use the Laplace transformation; no 
modification of the distribution function is necessary in this case as convergence at — oo is not in question. 
The Laplace transform P(p) of the distribution function is related to the characteristic function by 


P(p) = | ” e- Peder i ” paddy 
0 0 


] foe) 
==-_ —py d 
AR ef (y) dy 


= p“'d(ip). 
The transform Q(p) of Q(x) is given by e 2 
Q(p) = p*—P(p) 
= pltp), 
where the function p is as defined above. The standard inversion formula becomes 
t 


yt , 
_ e*p(ip) dp, (2) 


—10 


1 
Q(x) = Omi 


where y is an arbitrary positive number (there being no singularity of Q(p) with positive real part). 

For evaluation of probability points in the lower tail of the probability distribution curve of positive 
variates, an extension of a known result of Laplace transformation theory can be used. It can be shown 
that it P(p) can be expanded as the series 


@ 


P(p) = ae (0 > fy > fe>---)s 
j= 


assumed uniformly convergent for |p —«a| sufficiently large, then 
ie] 
P(x) = e% ¥ afT(—p)} 7 2-4; 
j=0 


the case a = 0 is proved by, for example, Carslaw & Jaeger (1948). The most convenient value of @ will 
depend on the variate; in general a non-zero value will give the most rapidly convergent series. 
For evaluation of probability points for which |x| is large, asymptotic expansions can be obtained if 
t) can be written in the form 
sia plt) = pxlt) + palt) 


n 
where pit) = D> bw + it), 
j=0 


p{th= LY b(w+ it), 
j=n+1 


where Rw) >0, wm <y <--> Uny >—l 


and the series for p,(t) are assumed uniformly convergent for |w + it| sufficiently small. 

In the inversion formula (1), the line of integration may be replaced by any other contour C such that 
there are no singularities of p(t) between C and the real axis, and the integrand is sufficiently small at 
infinity. (An analogous procedure can be followed for the inversion formula (2) in the case of positive 
variates.) Thus for large negative x the plus sign is to be used, and for large positive x the minus sign is 
to be used; in both cases the expansion is about the singularity nearest the real axis. If there should be 
two or more singularities with the same imaginary part there will be a contribution to the expansion 
from each of them. 
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The contribution of p,(t) is n db, 7 oe ' wh 
R,(x) = p> 5 lalt(w + it)" de; mo 
here the integrand has at most one singularity and the contour C may be replaced by a contour sur- 
rounding this point (positively or negatively in the respective cases) as in the derivation of Hankel’s - 
integral for the gamma-function (Whittaker & Watson (1946)). The substitution 
otit =—-t’/ |x| 
nb, f+) os 
then gives R(x) = > = | jeolal |x| —ej-1 e-t ( — 0’) dt’ pal 
j=027 J w ' De 
n 
= e-wlel 9) BAT (—0,)}? |x|. 
j=0 | 
The proof of a similar expansion is given by Carslaw & Jaeger (1948) but the series is given in a slightly Ca 
different form and the unnecessary restriction that vy > — 1 is imposed. . 
The contribution of p,(t), denoted by R,(x), may be estimated as in Carslaw & Jaeger (1948) with the | Cu 
appropriate change of axis; the result is that ' oi 
A 
R,(x) = ofexp{— Aw) |x|} |x|--*]. } : 
' 
Hence we have an asymptotic expansion Ga 
oc A 
R(x) ~ e~ol#l YY b{T( —v,)}> |x| Gu 
j=0 ‘ 
from which probability points in both tails of the probability distribution curve can be evaluated. j Gt 
JE 
3. APPLICATION : . : 
c 
Chernoff & Lehmann (1954) have shown that in making a y? goodness-of-fit test, estimation of the 
distribution parameters from the sample values instead of the cell frequencies leads to a statistic which | Ww 
is not asymptotically distributed as chi-square but as Ww 
k-s—1 k-1 W 
a Wt & A,u, | 
j=1 j=k-s 
where k is the number of cells, s is the number of parameters to be estimated, the wu; are independent 
standard normal variates and the A; are constants, When, for example, in fitting a distribution the mean 
and variance are estimated by the sample mean and variance, the statistic obtained has the limiting 
distribution X? = yt_+Ayut+Agut, 
where ¥?_, is a chi-square variate with k—3 degrees of freedom, u,, vw, are standard normal variates 
independent of each other and of y2_, and A,, A, are constants less than unity. Watson (1957) suggests 
that in practical applications, the probability that X* exceeds x should be calculated where z is the upper i 
5 % point of y2_,. For a normal distribution and the case k = 10, for example, the relevant value of z is } 
14-067 and Watson has shown the values of A, and A, to be respectively 0-042 and 0-297. 
For such problems the method of the present paper is well suited; for ; 
in 
Q(p) = p-*— p-(1 + 2p)-#*-9 (1 + 2A, p)-4 (1+ 2A, p)-4, 
and expansion of Q(p) about the singularity at — 4 leads to the asymptotic expansion 
e- te ghk—8) C, Cs 
~ 1+—+-—+...}, 
Ce) ~ sear —a RPE Ett } ow 
where the first two coefficients in the series are given by as 
C, = (k—5) {1 — } (a, +a)}, | su 
Cy = (K—5) (le — 7) {1 — } (oy + Og) + ge(OP + 2G) + Poet Xa}, 
% = 2A,/(L—A,), %_ = 2Aq/(1—A,). cr 
These terms are sufficient to give the result of 0-057 correct to three decimal places for the numerical ) 
values quoted above, while two more terms would give Q(x) correct to five places of decimals if required. 
Other methods seern more awkward to use in this application. The method of mixtures developed by TI 


Robbins & Pitman (1949), for example, yields a series which converges much too slowly to be of any use, 
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while other methods appear to be equally laborious. In general the same considerations apply to the 


more general quadratic form * 
t= x A; Xi; 
¥) = 


whenever one A; is much greater than the others. 


The authors are indebted to Dr G. S. Watson of the Australian National University for suggesting 
extension of the work to cover indefinite variates and for other helpful suggestions and comments. The 
paper is published with the permission of the Chief Scientist, Australian Defence Scientific Service, 
Department of Supply, Melbourne, Australia. 
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Some applications of two approximations to the multinomial distribution 


By N. L. JOHNSON anv D. H. YOUNG 
University College London 


1. INTRODUCTION 


The derivation of exact distributions of statistics based on multinomial variables is not simple, except 
in a few special cases. If n,n, ...,, have the joint multinomial distribution 


k 
P(N, Nagy +++) Ne) = wee (m74/n,!), (1) 


k k 

where & n;=N,7;>0and % 7; = 1, then the distributions of n,;,n;+,,, etc., are simply obtained 
j=1 j=1 

as binomials with parameters N,7,;; N,7;+7;, etc. But when studying the distribution of statistics 


k 
such as y¥2= & (n;—N7;)*(N7z;)-}, etc., some form of approximation is useful. 
j=1 


In this paper two approximations to (1) are used in deriving approximate significance limits of two 
criteria which might be used as alternatives to the standard y?-test of the hypothesis 
R=.= 2h =e. 


min; max n;— min n,; 


aq W= a 
an W 








The suggested criteria are R= 
max n; 











464 Miscellanea 


which are simpler to calculate than is x? (though neither R nor W can usefully be used if the 7,’s are not 
equal). In order to use these criteria we need tables of lower percentage points of the distribution of R and 
tables of upper percentage points of the distribution of W, when 7, = 7 = ... = 7 = k~!. A number of 
approximations to these values are considered. 

Also in a preliminary investigation, three approximations to the distribution of the maximum relative 
frequency, max (n,/N), will be considered. 


2. AN APPROXIMATION TO THE MULTINOMIAL DISTRIBUTION 


Putting p; = n,/N and treating the p,’s as continuous variables, we may use the approximate joint 
probability density function 
rw- ft (2) (o Ey=1 
I(P1» Pa ---» Pe) = P(N —1) (A573) ( <P 2B P= ). (2) 
siaaiaes j=1 \TUN 1) 75] of 
9(P1> Pes «++» Px) is to be interpreted as giving the joint distribution of any k—1 of the p’s; this is obtained 
k 
by replacing the omitted p, by 1— & p;. 
j+l 


This approximate distribution gives correct first and second moments and product moments for the 
p’s. Also it gives similar approximate distributions for subsets of the p’s and for quantities such as 
Pi, + Pi, +--+ Pi, (4 $ ty # «.- $ %,). Detailed examination of some properties of this approximation has 
been published in another paper (Johnson, 1960). 

It is useful to note that, from the point of view of distribution theory, we can regard the approximate 
distribution of the p’s as that of the ratios 


ce: ee (3) 
=x?’ =x?’ ’ xx?’ 
j j j 


where y?, x3, .--, ¥2 are independent y*’s with 2(N — 1) 7, 2(N —1) 7», ...,2(N — 1) 7, degrees of freedom, 
respectively. 


3. AN ALTERNATIVE APPROXIMATION 
An alternative approximation to the joint distribution of n,, 7, ...,%,, Which may be used if 


= %,=...=%, =F", 
may be obtained as follows. 

Let us consider the standardized multinomial variables w; = (n;— N7;)/[N7,(1—7,)]*. It can be shown 
that as N increases the joint distribution of w,, wg, ...,w, tends to a degenerate multinormal distribution 
with zero means, unit variances and covariance between w, and w,; equal to —(2,7,)*/[(1 —7,) (1—7,)]}. 
If 7, = 7, = ... =7, = k each covariance is equal to —(k—1)-}. 

Consider now a set of k independent unit normal variables x,, X2, ...,v,. Then it can straightforwardly 
be shown that the standardized deviates from the sample mean 


i k \t cs k \t a. k \t _ 

= (7-2), (= (%,—),..., (= (x, —2) (4) 
are jointly distributed multinormally with zero means, unit variances and equal covariances —(k—1)-}. 
Hence, when 7, = 7... = 7, = k~ the approximate multinormal distribution of the w’s may be con- 


sidered as the joint distribution of the standardized deviates given in (4). 
Several properties of this approximation to the joint distribution of the w’s have been considered by 
Young (1960). 


4. APPROXIMATE UPPER PERCENTAGE POINTS OF THE DISTRIBUTION OF MAX 7; 

Using the approximation developed in §2, we see that the distribution of max (n,/N) may be approxi- 
mated by that of Cochran’s criterion k 
maxs?/ & s?, 

j=1 


where the s?’s are independent y* variables, each with 2(N—1)k-' degrees of freedom (assuming 
NT, = 1%, =... 7, = k-). 

Tables of upper significance limits of this criterion are given in Eisenhart, Hastay & Wallis (1947, 
Chapter 15). Interpolating in these tables we find the values shown in columns (a) of Table 1. 
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Alternatively, if we use the approximation given in §3, we see that the distribution of {(k—1)/k}# 
max w,; may be approximated by that of max x;—%, the extreme positive deviate from the sample 
mean in a sample of k independent unit normal variables. Since 


*) max _[k t N 
k 1=\n (maxn,— 


it follows that the upper 100« % point of the distribution of X = max (n,/N) is approximately given by 
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1 u 1 


ee eee Se es 
Xo= 7+ Wvini * aN’ 


(5) 
where u, is the upper 100a % point of the distribution of w = max x;—Z. 


Tables of wu, are given by Nair (1948), and these have been used to give the values of X, shown in 
columns (6) of Table 1. 








Table 1. Approximate upper significance limits for max (n;/N) when 7, = 7, = ... = 1 = k- 
a= 0-01 a = 0-05 
c — \ a a \ 
k (2) (b) (c) (a) (b) (c) 
N = 25 
2 0-746 0-777 0-80 0-693 0-716 0-72 
3 -606 609 “64 547 554 56 
4 -532 “513 56 “471 464 -48 
5 -476 -450 -48 -416 -406 “44 
6 -440 -406 “44 +382 365 -40 
7 414 372 +44 +356 +334 -40 
8 393 +342 -40 +336 310 -36 
N = 50 
2 0-678 0-692 0-70 0-637 0-649 0-66 
3 524 “524 54 -482 485 50 
4 440 432 46 +399 397 40 
5 388 373 40 -348 342 36 
6 351 331 36 +312 303 32 
7 324 +300 32 286 274 30 
8 304 276 30 267 252 28 
= 100 
2 0-627 0-634 0-64 0-598 0-603 0-61 
3 469 +466 47 +438 439 44 
4 384 377 38 “354 352 36 
5 329 320 33 303 298 30 
6 292 281 28 266 261 26 
7 266 +252 26 241 234 24 
8 +246 +230 +23 221 213 22 


(a) based on Cochran’s criterion; (b) using equation (5) and Nair’s table; (c) using Young’s approxi- 
mation, with (6) and (7). 


The factor (2N)-! which appears in (5) comes from a continuity correction, since possible values of 
X = max(n,/N) are at intervals of N-. 
Columns (c) of Table 1 show values obtained from further approximate formulae (Young, 1950) 


kI,-s{(NX,,N(1—X,)+1] <a, (6) 


N(kX,—1)—4k at 
od ae = ol baa Hh 
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a—1 /n 
where i,(a,n—a+1)=1- = (")a-pe~, 
0 


f= 


1 z P 
(x) = Tan} .° te dt, 


and X, is the least possible value of X satisfying (6) or (7). 

Approximation (7) is useful when N is large and was used to obtain the significance limits in Table 1 
(columns (c)) when N = 100; formula (6) was used for N = 25, 50. It can be shown that the maximum 
error in significance level as computed by the left-hand side of (6) is less than $a*(1—k-1). In fact, all the 
values shown in columns (c) of Table 1 for N = 25, 50 are equal to the least X, such that Pr{X > X,} < a. 

It should be noted that, in the third approximation (columns (c)), values are given for max (n,/N) 
corresponding only to integer values of n;. This means that for N = 25, possible values are at intervals of 
0-04, for N = 50 at intervals of 0-02, and for N = 100 at intervals of 0-01. In columns (a) and (b) values 
are given formally to three decimal places, but in fact they would give practical procedures identical 
with those given by the next higher (or equal) possible column (c) value. 


Remembering this, we see that, for k = 2, approximation (5) is slightly better than the max s? > 3 
approximation. For k = 3, the three values given in table 1 would give identical practical ssitsiishlanien in 
every case. For values of k > 4, the max s? / 8? approximation is more accurate than (5), especially for 
the smaller sample sizes; for N = 25, 50, P Sag - SC between the column (b) and column (c) values 
become more pronounced as k increases. 

5. APPROXIMATE LOWER PERCENTAGE POINTS OF THE DISTRIBUTION OF R = min n,/max n; 


minn; ming; 





Noting that = 3 
maxn; maxp; 

§2 indicates that this ratio should be distributed approximately as min y?/max y?. If 7; = k-" for 
j = 1,2,...,% then each y? has the same number of degrees of freedom, 2(N — 1)/k. Table 31 of Pearson & 
Hartley (1954) gives significance limits for this statistic; from this table approximate significance limits 
for min n,/max n,; can be obtained by interpolation. Some further approximations can be obtained as 
follows. 

If x? has v degrees of freedom, then log, y? is distributed approximately normally, with expected value 
(4) +log, 2 and standard deviation [‘?(4v)], where 


d d? 
¥(x) = 5 [log,T(e)] and Fx) = — flog, T(a)]] 


are tl digamma and trigamma functions respectively (Bartlett & Kendall, 1946). Since —log, R is 
approximately distributed as the range of logarithms of k independent y?’s each with 2(N — 1)/k degrees 
of freedom, the lower 100« % point of the distribution of R will be approximately equal to 


exp (— wz /[P ((N —1)/k})), (8) 


where w, is the upper 100« % point of the distribution of range of k independent unit normal variables. 
A further approximation, viz. YO (2) = (2@—4)-2 


which is quite good for 2 > 2, converts (8) to the simpler form 


exp (—W, (*-1)’). (9) 


Table 2 gives some approximate lower 5 and 1 % significance limits for R, using 

(i) Table 31 of Pearson & Hartley (1954); 

(ii) approximation (8); 

(iii) approximation (9); 

(iv) an approximation (to be described in §6) which is obtained, using the approximate distribution 
of the standardized multinomial variables given in §3. 

The accuracy of the approximation ¥’ (x) = (~— 4)-1 is so good that (ii) and (iii) agree to two places of 
decimals, even when is as small as 2. Hence only one figure is shown for these two approximations. 
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Table 2. Approximate lower significance limits for R = minn,/max n, 
(Actual significance levels in parentheses.) 








5% points 1% points 
ss — Y i * > } 
k (i) (ii), (iii) (iv) (i) (ii), (iii) (iv) 
N = 25 
2 0-44 (0-0433) 0-44 (0-0433) 0-46 (0-0433) 0-34 (0-0146) 0-34 (0-0146) 0-36 (0-0146) 
(0-1078*) (0-1078*) (0-1078*) (0-0041*) (0-0041*) (0-0041*) 
3 0-29 (0-0620) 0-30 (0-0620) 0-32 (0-0802) 0-22 (0-0203) 0-22 (0-0203) 0-24 (0-0286) 
(0-0516*) (0-0516*) (0-0620*) (0-0151*) (0-0151*) (0-0203*) 
4 0-21 0-21 0-23 0-14 0-15 0-17 
5 0-15 0-16 0-18 0-10 0-11 0-13 
6 0-11 0-12 0-14 0-07 0-08 0-10 
N = 50 
2 0-57 (0-0649) 0-57 (0-0649) 0-58 (0-0649) 0-47 (0-0153) 0-48 (0-0153) 0-48 (0-0153) 
(0-0328*) (0-0328*) (0-0328*) (0-0066*) (0-0066*) (0-0066*) 
3 0-43 0-44 0-44 0-35 0-36 0-36 
4 0-34 0-35 0-36 0-26 0-28 0-29 
5 0-28 0-28 0-30 0-21 0-22 0-23 
6 0-23 0-23 0-25 0-17 0-18 0-19 
N = 100 
2 0-67 (0-0569) 0-67 (0:0569) 0-68 (0-0569) 0-60 (0-0120) 0-59 (0-0120) 0-60 (0-0120) 
(0-0352*) (0-0352*) (0-0352*) (0-0066*) (0-0066*) (0-0066*) 
3 0-56 0-56 0-56 0-48 0-49 0-49 
4 0-48 0-48 0-48 0-40 0-41 0-41 
5 0-42 0-42 0-42 0-34 0-35 0-36 
6 0-36 0-37 0-37 0-30 0-30 0-31 


Approximations based on: (i) distribution of s2,,, /s?,, ; (ii) equation (8); (iii) equation (9); (iv) equa- 
tion (13). 


Exact values of the significance levels (i.e. Pr{R < R,}) corresponding to a few of the approximate 
significance limits are shown in parentheses. These values often differ markedly from the nominal 
significance levels. This may be ascribed, in several cases, to the discontinuity of the distribution of R. 
To illustrate this, the next possible value of the tail probability above or below Pr{R < R,} is also given 
marked with an asterisk, according as to whether Pr{R < R,} is less than or greater than the nominal 
significance level a. 


6. AN ALTERNATIVE APPROXIMATION TO THE DISTRIBUTION OF R 
Turning now to the approximation developed in §3 we see that 
minn;, minz,—%+(N/k)t 


R= —— » — a 10 
maxn, ‘maxa,—%+(N/k)t (10) 





Taking logarithms, we have 


min x;—% max %;—Z 
= —_— j- —_———_— |. 11 
log, R = tog, 1 + (N]k)E | log,| 1 + (N/k)E ] (11) 
The right-hand side of equation (11) may be expanded in powers of N-* to give 
log, R = —(k/N)* (max 2;—min2,;)+0O(N-). (12) 


Neglecting terms of order less than or equal to N-! we obtain approximation (iv) 
R, = exp [—w,(k/N)*], (13) 


where w, is the upper 100 % point of the distribution of the range of k independent unit normal variables. 
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Generally, each of the four approximations appears to give rather too large a value for R,, approxi- 
mation (iv) being the least accurate. However, it can be seen from the values of the probabilities given in 
Table 2 that there is appreciable discontinuity in the distribution of R, even when N = 100. This means 
that in several cases the exact values of the actual significance levels corresponding to the approximate 
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significance limits are in fact the closest possible values to the nominal level a. 


The difficulty of dealing with the discontinuities is shown by the figures in Table 3, where true 
probabilities are given for certain parts of the distribution when N = 25 and k = 2,3. Arrows mark the 


position of the lower 5 and 1 % significance levels given by approximation (i). 


Table 3. Exact distributions of R for N = 25, k = 2,3 





k=2 

R* Pr {R < R*} 
0-136 0-0002 
-190 -0009 
+250 0041 
-316 -0146 
389” 0433 
0-471” -1078 
-563 +2295 
-667 -4244 
-786 -6900 
924 1-0000 





k=3 

"af ~*~ a 
R* Rr {R < R*} R* Pr{R < R*} 
0-077 0-0012 0-187 0-0119 
-083 -0015 -200 0151 
‘lll -0016 -214 -0203 
-118 -0017 231” -0283 
+125 -0022 +235 -0286 
+133 -0033 +250 -0409 
-143 -0049 -267 -0457 
+154 -0074 273 -0516 
-167 -0103 -286 -0620 
176 -0107 -308 -0802 


Table 4. Approximate upper significance limits for W = max (n,/N) — min (n;/N) 


ao 


6 


bo 


ao or 








N = 10 
a = 0-05 a= 0-01 
0-619 (0-0215) 0-814 (0-0020) 
(0-1094*) (0-0215*) 
0-604 (0-0320) 0-752 (0-0056) 
(0-0846*) (0-0320*) 
0-574 (0-0501) 0-696 (0-0113) 
(0-0113*) (0-0017*) 
0-546 (0-0293) 0-650 (0-0041) 
(0-0707*) (0-0292*) 
0-520 0-615 
N = 50 
7 $$$ $$$ 
a = 0°05 a= 001 
0-277 (0-0649) 0-364 (0-0066) 
(0-0328*) (0-0153*) 
0-270 0-336 
0-257 0-311 
0-244 0-291 
0-233 0-275 


(Actual significance levels in parentheses.) 








N= 3% 
ct A ee | 
a = 0-05 a= 0-01 
0-0392 (0-0433) 0-515 (0-0146) 
(0-1078*) (0-0041*) 
0-382 (0-0487) 0-476 (0-0116) 
(0-0920*) (0-0048*) 
0-363 (0-0317) 0-440 (0-0128) 
(0-0703*) (0-0046*) 
0°345 0-411 
0-329 0-389 
N = 100 
= aes ba 
a= 0°05 a=0-01 
0-196 (0-0569) 0-257 (0-0120) 
(0-0352*) (0-0066*) 
0-191 0-238 
0-182 0-220 
0-173 0-206 
0-165 0-194 


7. APPROXIMATE UPPER SIGNIFICANCE LIMITS OF THE DISTRIBUTION OF RANGE 
OF RELATIVE FREQUENCIES 


As a further application of the approximation developed in §3, we will consider the distribution of 


W = max (n,/N)—min(n,/N). 


OO 


ti 
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Using the results obtained in §3, we see that 
W = w(kN)-, (14) 
where w is the range of k independent unit normal variables. 

Table 22 of Pearson & Hartley (1954) gives significance limits for w. These have been used in (14) to 
give approximate values of the upper 5 and 1 % points of the distribution of W, as given in Table 4. 

Exact values of the actual significance levels (i.e. Pr{W > W,}) corresponding to some of the approxi- 
mate significance limits are shown in parentheses. The second figure, marked with an asterisk, is the next 
possible value of the tail probability, above or below Pr{W > W,} according as to whether Pr{W > Wa} 
is less than or greater than the nominal level a. 

The exact values of the actual significance levels, corresponding to the approximate significance 
limits, often differ markedly from the nominal level, «. However, the differences in the pairs of values of 
the tail probabilities, given in Table 4, indicate that this is almost entirely due to the discontinuity of the 
distribution of W. In fact, for every case in which the tail probabilities are given, the approximate 
significance limits in Table 4, would give practical procedures for which the difference, between the 
actual significance level (Pr{W > W,}) and the nominal level a, is the minimum possible. Remembering 
this, the approximation appears to be reasonably adequate. 
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Some distributions arising in the study of generalized mean differences 


By T. A. RAMASUBBAN 
London School of Economics and Political Science 


1. In my first paper (1958) on mean differences, I defined the coefficient of mean differences of rth 
order as 


* =| [l2-ulr pe pc deay (1-1) 


(with integrals replaced by summations for discrete distributions). This is a generalized version of the 
usual A,. I obtained the value of A, explicitly in the case of certain discontinuous populations such as 
positive and negative binomial, the Poisson, geometric and so on. Later (1959), I proceeded to consider 
the quantity A, itself for the binomial and the Poisson distributions and, using certain functional 
properties found to be obeyed by (1-1) in these instances, evaluated in reasonably compact form, the 
expressions for A, which are valid for all integral values of r. It was shown that whereas the even order 
mean differences can be determined very simply from the relation 


2r—2 _ (2r 

Noy = Ble + DY (-1y( ; 

j=2 J 

where the u’s are the mean-moments of the distribution in question, the odd order A’s are more difficult 
to express explicitly. For the binomial distribution, they are given by 


) tars (1-2) 


r+1 n-8s 
Aoi, = 2 x {eran'>( * ) pag Py{—n+ 28, 3(28+ 1); 28+ 1; 4pq} 
o= / 


+a; ,n® ("~1) p*-1q*s-! Fy{—n+ 28 —1, 4(28s—1); 2s—1; 4pq}}, 
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where n = n(n— 1) (n—2)...(n—8+1), the hypergeometric function is given: by the finite series 


Bax  a(a—1)P(P+1)2? 


oF (—a, 2; y3x) = 1- yl! ~ -Wy+1) 21 


and a,, and a}, are constants whose numerical values have been tabulated for the first few r and s. For 
the Poisson distribution the corresponding expressions are 





r+1 
Aor41 - 2e-8A % A‘{a,,1,(2A) + 4,,1,_1(2A)}, (1-4) 
s+1 


where J,(2A) is the vth order Bessel function cf the first kind with argument 2A. 

In this paper, I examine the general problem of expressing the A’s in explicit form from a different 
point of view. 

2. The underlying idea behind the present method follows from definition (1-1) for A,. Defined as it is, 
it may be considered as the expectation of |x—y|’, or in other words, as the rth absolute moment of a 
density function whose stochastic variable d is the algebraic difference of two variables x and y which 
follow independently some given parent distributions p(x) and p(y). 

3. In order to enable a coherent examination of the A,’s derived already, we shall discuss here the 
application of this approach to the three important cases which we have considered earlier, viz. in which 
x and y have (i) the binomial, (ii) the Poisson and lastly (iii) the geometric distribution. 


(i) THE BINOMIAL PARENT 


Since x and y are independent and similarly distributed in the binomial fashion ") pg", the combined 


probability is 
plx,y) = (" ") greg =. 
od A 


The distribution p,(d) of the difference d = (x—y), d > 0 is therefore obtained from 


d — n " 2y¥+d,72 2 d 
= u+ n—2y— a ° 
na ~ (') (, ta)? . nine 


The sum in (3:1) is the coefficient of ¢-¢ in {(q¢+ pt) (q+ p/t)}", i.e. in {1+ {(1—2#)?/t} pg}" and this, when 
expressed in terms of the hypergeometric function ,F',, leads to 


Pa(d) = (") (p9)* F{—n-+4, ¥(2d-+ 1); 2d+ 15 4pg}, (3-2) 


If, however, dis negative and equal to —d’(d’ > 0), yandd in (3-1) are to be simply replaced by x and d’, 
respectively, so that the summation now with respect to 2 leaves the final expression for the form of 
p,(d’) exactly identical with (3-2). Thus the difference d, which takes all the integral values between 
—nand +-n, has a distribution symmetrical about zero. The odd moments of p,(d) are therefore zero and 
its even moments are given by the mean differences A, of the binomial distribution. 

Let us then consider this mean difference to be denoted by ,A,. We have 


. 
nA, = Eld|" = 2 ¥ d'p,(d) (3-3) 
d=0 


irrespective of whether r is odd or even. Substituting for p,(d) from (3-2) and using a result connecting the 
contiguous ,F'}, namely, 


Fy{—n+d, }(2d+1); 2d+1; 49} = Fy{—n+d, }(2d—1); 2d—1; 4pq} 
ee (pg)? Ff —n +d +2, }(2d+3); 2d+3; 4pg}, (34) 


which provides the main key to the summation in (3-3), it can be written, after a suitable rearrangement 
of the resulting terms, as 


n—-1 n—1 
nA, = 2npa| XD (d+1)"prald)— & (17,10 | 
d=—1 d=1 


ll 


(r=1)) ae n-1 


2npq [\ —1)""*p,_1(0) +2 7 2j + :) > i ee ad | 


{hr—-1)) /r—] 
2npa| (= 1-8 gFy(—n-+ 1,451; Apa + x ) Aaa) (3-5) 
j=0 \294+1/]n-» 


where [}(r — 2)] is, as usual taken to mean the greatest integer contained in the fraction }(r—2). 
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This is the recurrence relation connecting A, with A,_,, A,_»,..., Ag and is valid for r > 1. 
The case of r = 1 can be derived likewise with the help of (3-4) or be obtained from (1-3) by putting 
r = 0 therein, thus giving in either case 


nA, = 2npq[.F(—n+ 1,3; 1; 49g) +(n—1) pg 2F\(—n+ 2,8; 3; 4p9)]. (3-6) 


Further, by distinguishing the even order differences from the rest, (3-5) can be shown to reduce to a 
simpler form. For, we then have, 


r—1 (2r—1 
nAen = 2npa| — oF, (—n+1,4; 1; 4p9)+ ¥ |. Ja aherars 
j=0 2j+ 1 


r—2 /2r—] 
= 2npa| —aFi(—n-+ 1,3; 1; 49g) +(n—1) Ag+ & ( F J vte-n-s| (3-7) 
j=0 27+1 
n 
and from the definition (3-3) for ,A,, »Ag = 2 }} p,(d) which sums up to the value 1+ ,F,(—n, 4; 1; 4pq) 
d=0 n 
on account of the fact that p,(d) is symmetric and that ) p,(d) = 1. Hence, from (3-7) 


=—n 
r—2 (2r—1 
ne, = 2npg [ 7 > - + i) o-vde-a-s | ° (3-8) 
Thus for r=1, A, = 2npq; 
r= 2, Ag = 2npg{l +3 (n»yAiy} = 2npg{l + 6(n— 1) pg} 
and so on. The same results, of course, can be obtained from (1-2) after substituting the appropriate 
moments of the binomial distribution. 


In addition to (3-5) and (3-8), a specific relation for A, in terms of (n— 1), n and (n+ 1) is also worth 
noting. For this purpose we imply the result 


(4npq — 2pq—2n) .F (—n+1, 4; 2; 49g) + (n+ 1), PF, (—n, 3; 23 4pq) 


—(n—1) (4pq—1) Fy(—n +2, 3; 2; 4pq) = 0 (3-9) 
in combination with (3-6) which reduces to 


nA; = 2npg ek (—n+ 1, 3; 25 4pq). (3-10) 
By substituting for ,F’, in (3-9) the corresponding A,’s from (3-10) and simplifying we have the required 
esult 
‘ nvr + (4pq—2—(2/n) pg} ny — (49-1) (n-wAr = 0, 


2 
or (n¢yAr = (499—1) {n—-yAir— nAt+ (1 +722) nAy. (3-11) 


In particular if p = g = 3, (3-11) gives (,4,A, = {1+(1/2n)},,A;. This relation was suggested without a 
complete proof by Gini (1912). 


(ii) THE PoIssoNnN PARENT 


Once we have the distribution p,,(d) for the binomial case, the distribution p(d) for the Poisson can be 
readily derived by the usual method of considering the limit of the former as n > 00, p>0 and np > A. 
Since under these limiting conditions 


oF (—n+a, fp; Y3 4pq) > F'\(h; Y3 —4A), 
n 
P,(d) = (") (pq)? oF’ {—n +d, $(2d + 1); 2d +1; 4g}, 


na 
p(d) = Zi 1'1{4(2d + 1); 2d+1; —4A}, 


or in terms of J,(2A) (defined earlier), p(d) = e~*AI,(2A). (3-12) 
Irwin (1937) obtains (3-12) from the joint distribution of the two independent variates x and y, each 
following the Poisson law, oA 
p= — &=29)- 


Once again, (3-12) is symmetrical about zero since J_ 4(2A) = I, (2A) for all integral d. 
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The procedure of establishing the linear relationship between the A,’s is the same as before and is now 
accomplished by using the fact that 


dI, = A(Ig-y—Tay,), where I, = 1,(2A). (3-13) 


ao 
Hence A, = 2e-84 §) dl, 
d=0 


« 
= 2de-*A YY dt '(L4-4 —La41)s 
d=0 


which, after suitable adjustments, finally gives 


A yet 2re-as. 42a Se (To "Va 3-14 
7 =(-1) e ot > (3; ) r—2j-2 ( ) 


for r > 1. For r = 1, the use of (3-13) leads to the known result 
A, = 2Ae-*A(I, + 1) (3-15) 
(also obtained by putting r = 0 in (1-4)) so that A, of any given order can be very conveniently built up 


with the help of (3-14) and (3-15). 
In case of even 7, however, a simpler relation exists, and we can show as in (3-8), that 


2r—1 . 
hy = 2a 1+"3 x ay ae Ag-—aj-— |. (3-16) 


In particular, A, = 2A, A, = 2A(14+3A,) = 2A(14+ 6A) 
and so on, which also constitute the even mean-moments of the difference distribution p(d) and agree 
with Irwin’s expressions. 
(iii) THE GEOMETRIC PARENT 
Finally, let us examine the case of geometric probability 
p(t)=qp's qtp=1. 


Starting with the joint probability p(x, y) = g?p**+” it can be shown as in (i) that the distribution of the 
difference d = x—y, follows the law, 


p(d) = 





a (-o<d<o). (3-17) 


Thus the odd moments of p(d) vanish and the even moments of order 27 are identical with A,,. 
The explicit values for the generalized mean differences A, are given by 





2q wo 
A, = —— d'p(d 
het Pm ‘p(d) 
2q°p 1 ul 
peng 5 aii A., p*-! 3°18 
i-pt—pya 2, rsP (3-18) 
2q°p 
= ——_-_—__A ‘ “19 
(i—p) qr Ap) say (3-19) 


where the A,, are the Eulerian numbers. From (3-18), we thus have 





2q*p i 2p 
A, = = = 2° 
—pg 1—p 
2g'p l+p _® 
1—p? g ag q’ 





A, = 


A. = 2UP 1+4pt+p? _ 2p(1+4p+p") 


l-p og! si p®) 


) 


— 
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The connexion between these A’s can be established either directly from (3-18) or from the relationship 
d 
A,(p) = rA,_,(p) + (1—p) dp 47-1()- (3-20) 
On substituting the relevant expressions for A’s from (3-19), (3-20) gives 


2, d 
A, = (+25) Aya (3-21) 
which unlike the previous relations is in the form of a difference-differential equation. 

4, On the whole therefore, the indirect method described here seems worthwhile in enabling us (i) to 
obtain the A’s in forms capable of easy and systematic handling and (ii) to study simultaneously, by 
identifying the moment-constants of p(d) with A’s, these secondary distributions, some of which as we 
have seen, belong to the special transcendental type. Generalizations and extensions of the above results 
may be attempted in many ways, as for example, by assuming that x and y have the same discrete forms 
but with different parameters or that they belong to two different discrete parents. Similar variations are 
possible for the continuous cases also. 
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On certain characteristics of some discrete distributions 


By GEORGE E. BARDWELL 
University of Denver 


1. This paper stems from the following remark by Ramasubban (1958) on the mean deviation of some 
discontinuous distributions: ‘Dr Johnson. . .has pointed out a remarkable general result which includes 
the hypergeometric, the binomial, the Poisson and the geometric distributions.’ The result is 


mean deviation (M.D.) = 2 (variance) (frequency function at [~]), where [] is the 
greatest integer not greater than the mean. (1) 


The statement is, in fact, true for the binomial and the Poisson, true for the geometric distribution for 
integral values of 4 but does not hold for the hypergeometric.* In considering it I was led to some 
properties of discontinuous frequency functions which are presented below. 


2. Letf(x,n, p) bea discrete probability density functicn of x(x = 0, 1, 2, ...), with parameters n and p 
where p may be continuous in the interval 0 < n < a < o. Let yu be the mean of the distribution and 
pf, the ith moment about the mean. y is then a function of n and p, say g(n, p). Suppose that for fixed n, 
g(n,p) is continuous and strictly increasing in the interval (0,a). Then it has a continuous strictly 
increasing inverse h(n, 4) = g-1(n,p) = p. For each « let éf/ép and oh/dp exist in (0, a). 


* Editorial Note. Mr Ramasubban points out that for the hypergeometric 


r= (2) (n—e)/(n) 


Johnson’s relation holds except for a term N instead of N—1 in the denominator, i.e. 


3d, = f(m) ini a . 


where m = [y]. 


474 Miscellanea 


THEOREM 1. If f obeys the relation 


"hes wn, p){x—v(n, p)}f, (1) 
then (a) v(n,p) = pt, (2) 
() w(n,p) = 1/He» (3) 
d i- e 
(c) Ke poe *(¢= 1) ma} . (4) 
| are : 
We have a ap = dp a (5) 
Hence, from (1) Xw(n, p) {x —v(n, p)} f = 0 
iving (a) immediately. Since Le - = of 
giving (a) immediately. op” b)f = (x@—p) aut 
we have, using (1) with p= uN, p), 
ra] 
au MS = w(n, p) (e«—p)*f—f. 
Summing over 2 we find 0 = w(n, Pp) H2—1, 


where (b) follows. 
To establish (c), write 


ies = — (6-1) (7—p) f+ (@—wy =f 


2 ; 1 : 
=~ (=D + = (wwf 
2 
Summation of both sides for x yields (c). 
3. A characteristic of the family of functions obeying (1) is that each has a single maximum which 
occurs when x = 4. This property is shared by the binomial, the negative binomial, the Poisson, the 


logarithmic and the geometric distributions. The iterative process (4) for finding the moments is well 
known for the binomial and the Poisson. 


TuHEOREM 2. The density function satisfying equation (1) is of the form 
c— 
I (a,n,p) = C(n, x) exp {| oe ap| . (6) 
#(dp/dp) 


Tatty 


In fact equation (1) may be written 
Op Pe 


For fixed n, (a —)/{u,(dp/dy)} is a function of p alone and thus we have 
of «ph 


ap pt(dp/dp) 


as a linear equation of first order in p. The solution is that given in (6), O(n, x) being a normalizing constant 
such that the total frequency is unity. It is readily verified that the distributions mentioned earlier in this 
section satisfy the relationship. 





4. THEOREM 3. 
For the family of distrivutions of equation (6), 


F) 
M.D. = — Hag (Lal P), (7) 


[4] 
where Flphn.p) = & fem) (8) 
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oo {w)] o 
We hues D (e-wf=- F w-ms+ Y (e-ws=o. 
xr=0 x=0 z=[y)+1 

oo 773] 
Then os BOs = 22 (H—2)f. (9) 
Substituting from Theorem (1) the expression 

of 
Pron = (~«—p)f, 
[u) éf 

we have M.D. = — 2flg pf Op 

= = yy PU(y) 

= aay /),n,p) 


as given at (7). 

5. A further result can be obtained for certain distributions, such as the Poisson, which obey an 
additional restriction. 

THEOREM 4. 


If the members of the family of distributions obeying equation (1) also obey 





d 
ap! ™P) = f(x—1,p)—f (x, p) (a = (ARS) FE (10) 
then (a) M.D. = 2pef ([H], P) + 2(u — M2) f (0, p), (11) 
~ HV +h2—2) 
(b) SP) =I$ (OP) Vera ay” (12) 
with f(0, p) = 


M(1, 1+ 4-H Hs) 
where M is the confluent hypergeometric function. 


[wl 
We have directly M.D. = 2 $ (u—x)f 
xz=0 


[4] 
= 2S (ua) f+ 2nf (0,2). 
z= 
Using Theorem 1 and (10) we then have 
[ul] 
M.D. = 2 bal f (x,p) —f (w— 1, p)} + 2nf 0.) 
r= 


= 2pef ([H), Pp) + 2(M— Ma) f (0, P) 
as given at (11). Further, replacing x by 2+ 1 in (10) we have 


— 
f(x,p)—f(e+1,p) = “Et a+ Lp). (13) 
2 


Regarding this as a difference equation we readily find equation (12). 
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Approximate tests for m rankings 


By H. LINHART* 
National Institute for Personnel Research, South African Council for Scientific and Industrial Research 


1. INTRODUCTION 


One or two sets of rankings of n objects are given. The sets, of size m, and mg, are regarded as random 
samples from a population of rankings. Approximate tests for the following hypotheses are described 
below. 

For one set of rankings 

H.1: the mean ranks of a certain subset of the n objects are identical. 

For two sets of rankings 


H. 2: the n mean ranks (generally different within a population) are identical in both populations. 

H.3: the coefficients of concordance are identical in both populations. 

The investigation which gave rise to the development of the tests might be sketched here for an 
illustration. Bantu pupils have been asked to rank 6 different jobs in a number of job families according 
to their ‘preferences’. The object of the study was to get an impression of the occupational ambitions of 
Bantu youths, to find out whether there is a common job hierarchy, and if so whether it changes with 
educational standard of the youths. 

Coefficients of concordance were computed within the three educational groups (Standard VI, Form III, 
Form V) and in most cases found to be significant. But a more thorough statistical analysis is not possible 
without tests of differences between educational groups (H. 2) and tests whether a hierarchy obtained for 
some group is really significant in all its parts (H.1). Information whether agreement of opinion within all 
educational groups is equal or not would be of additional value (H.3). 

The following terminology will be used: a ranking is a row containing the n ranks, 1, 2,..., n, in some 
order. A fixed distribution of rankings, specified by the probabilities for the n! different rankings, 
simultaneously determines the n-variate distribution of ranks. 

The methods employed are those used by Stuart (1951). No assumptions are made about the distribu- 
tion of rankings. Suitable statistics are chosen and the first moments of the statistics are calculated as 
functions of the cumulants of the distribution of ranks. The expressions for the moments are simplified by 
neglecting cumulants above a certain order, and the cumulants left in those expressions are replaced by 
their k-statistics. The approximate moments so obtained are used to fit some simple distribution for the 
statistic under the null hypothesis, and the test is carried out. 

Stuart (1951) obtained four moments and then used Karl Pearson’s criterion to decide on the most 
appropriate type of distribution to fit. This would be too complex a procedure to carry out here. We 
calculated therefore only the first two moments and suggest fitting the simplest tabulated distribu- 
tions: the normal distribution for statistics ranging from —0oo to +00, and the y?-distribution for 
statistics ranging from 9 to oo. 

The procedure described above yields, of course, only very rough results and has to be applied with 
sense. Stuart (1951) developed and applied successfully similar tests which involve the same degree of 
approximation. This and the fact that no better methods are available seems to justify putting forward 
further crude methods. 

The crux of the matter is that too many parameters enter the problem (n! minus one) if any distribution 
of rankings is admitted. As Kendall remarked (1950), the major outstanding problem of ranking theory 
is to find some way of specifying a population with a tractable number of parameters. As long as that 
problem has not been solved one has to be satisfied with crude methods, similar to those suggested here. 


2. NorTatTIon 


The notation follows that of Stuart (1951). Cumulants and k-statistics are written in the customary 
notation (Fisher, 1928), but where possible zero indices are omitted. If not otherwise indicated all 
cumulants and k-statistics appearing in formulae or in computations are those of the distribution of 


* Now with the African Wool Textile Research Institute, Rhodes University, Grahamstown. 
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ranks. Where necessary « and k are used for cumulants and k-statistics in the one population and A and 
l for cumulants and k-statistics in the other population. Summation is‘always over all relevant variables 
(‘objects’), permutations are not excluded. To give an example: for three objects (a three-variate distribu- 
tion of ranks) 2X(k19 — kp,)? is identical with 2[ (499 — ko19)? + (Koro — Koo1)? + (A100 — Ko01)"]. The notation is 


n 
easily understood if one reads X(kyy—ky;)? as (kM) — kP)*, where k&® is written for a k-statistic 


1,55 143 
with n indices, the ith index being a, the jth index being f, all other indices being zero. 


3. AN EXTENSION OF STUART’S TEST 


Stuart (1951) gave a test for differences in mean ranks between any two of the n objects which have 
been ranked. His test statistic is kj) —ko,, the observed difference in mean ranks of the 2 objects. If the 
equality of more than two mean ranks has to be tested, a reasonable statistic seems to be 


t = LX(kyy— ko,)*, (1) 


where the summation extends over all objects which have to be tested. 

The mean and variance of t may be obtained in the following way. E(t) and E(t?) — H(t) are expressed in 
terms of moments of the multivariate distribution of the mean ranks k,. The moments are then expressed 
in terms of cumulants, and finally the cumulants of the distribution of mean ranks are calculated as 
functions of cumulants of the distribution of ranks. Here, where only first order k-statistics are involved, 
the last step is easily done because 


K. 
ee: | er 
Kystu... 1) gat t8titut oe 1? (2) 


where r, 8, ¢, u,... are zero or positive integers and where the cumulants on the left side are those of the 
distribution of mean ranks and on the right side are those of the distribution of ranks. 

The actual calculations are very lengthy because of the complicated formulae connecting moments and 
cumulants. The methods and results given in Kendall (1940) and Cook (1951) were used whenever possible. 
The calculations are not displayed here and one may refer to Stuart (1951) who worked out in detail a few 
similar calculations. 

The following results for mean and variance were obtained 


1 
K(t) = mn (K20 + Koa 2K11), (3) 


2 
V(t)» mate 2 (Ko + Koz — 2K31)? 


+422 2(K299— K110 — K101 + Ko11)” 
+ DLZ=X(Kyo10 — K1001 — Kor10 + Ko101)7}- (4) 


The exact variance contains cumulants up to order four, the formula given above is an approximation, 
where cumulants of higher order than two have been neglected, (this is equivalent to neglecting terms 
having a higher power than two of m in the denominator). 

If the test has to be applied, the cumulants must be replaced by their k-statistics and a distribution 
must be fitted for t. It is proposed to use a y?-distribution with v degrees of freedom for t/a. If this is 
done, one has to put 








V(t) 
a= or" (5) 
2H%(t) H(t) 
==, (6) 
V(t) a 
in order to assure for ¢ a mean and a variance as given in (3) and (4) above. 
4, TEST FOR EQUALITY OF MEAN RANKS BETWEEN TWO GROUPS 
The proposed statistic is t= E(k, —1,)* (7) 
. Ke , As 
The mean of ¢ is E(t) = X{—+—}, (8) 
Mm Ms, 
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2 
and the variance (exact) Vij==z [ =: - As rs 2(“ + | 


my * my “\m,  m, 
2 

+== Sat Sas ot Se)". (9) 

m= ms Mm, Ms, 

The approximate variance is 

kK, A.\? Ky An\* 

V(t) = 22 —+—] +2zz>(—+—}. (10) 
m Ms m ms; 


Here again a x?-distribution with v degrees of freedom should be fitted for ¢/x, where v and « are given by 
(6) and (5). 
5. TEST FOR EQUALITY OF COEFFICIENTS OF CONCORDANCE BETWEEN TWO GROUPS 


We define w, the coefficient of concordance in the population, in analogy with W, the coefficient of 
concordance in the sample, as 12 


0 = nn? —1) 


Testing for equality of coefficients of concordance reduces thus to testing for equality of Xx?. 
The statistic used is 


X(K,— 3(n+1))*. (11) 


t = D(k?—2). (12) 
It has mean E(t) = =(7 ~*:) ; (13) 
mM, My 


variance (exact) 


V(t) = = Ka ce 4k ky + 23 4k aki we A - 4A5A1 + 203 na 4A, 05 
ms m2 m, ms ma Ms 














+ ns(“ + 2k y0Ki2 + 2koKn + 2k + 411 Koi K10 * Ans + 2AroAre + Ao Any +204, + 4A Aor 0) , (14) 
ms m? mM, ms ma Me 
and approximate variance 
Vit) ~ 4n(“ 282) pany (Saati, Meee) 7 (15) 
m m 


M 2 my, mM, 





It is suggested that a normal distribution be used for ¢. 


6. EXAMPLES OF APPLICATION 


The k-statistics were computed using the following formulae 


(16) 


1 81098; 


m 
where 8,;; = })x'y’, and x and y are the ranks of the objects involved. 
The following checks were used 


X83, = 4mn(n+1), 
Xs, = ¥mn(n+ 1) (2n+1), (17) 
XXs,, = (Ls,)?/m— Xsq. 
The sum of the elements in the jth column of the complete s,, matrix (zeros in the diagonal): if m; 


n 
individuals give the jth object the rank i, the column sum is equal to 5) m,i{4n(n+ 1) —7}. For higher 


ve 
moments similar checks may be worked out using, for example, David’s & Johnson’s formulae (1954, 
p. 239). 








obt 


int 
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The test introduced in §3 above has been applied to Stuart’s (1951) data. The following results were 
obtained in a test for equality of mean ranks of jobs B, D and G: 
t=851, E(t) = 0-318, 
V(t) = 0-112, a = 0-177, 
v= 1-80, x? = tla = 48-1. 


For two degrees of freedom this value of y? is highly significant, a result which agrees with Stuart’s 
findings. 
Among other results, the following observations were made in the investigation mentioned in the 
introduction. 
Table of frequencies of ranks 














Form V Standard VI 
c A | i A ae 
Ranks 1 2 3 4 5 6 1 2 3 4 5 6 
A Tradesman 1 4 5 6 ll 3 3 7 6 6 6 2 
B Businessman 0 11 5 6 6 2 0 3 2 7 12 6 
C Professional man 28 1 1 0 0 0 13 5 5 2 3 3 
D Clerk 1 9 9 7 3 1 8 6 7 7 i 1 
E Public servant 0 5 9 8 6 2 6 6 610 6 1 1 
F Factory operative 0 0 1 3 4 22 0 3 0 2 S 
Table of k-statistics 
Form V 
Cc es i 

k, ke A B C D E F 
A 4-033 1-829 — 0-1242 — 0-1755 — 0-8322 — 0-9194 —0-0176 
B 3-433 1-843 — — —-1134 — 6943 —-7608 — +3900 
C 1-100 0-162 —_ — — —-0172 -1000 -0448 
D 3-167 1-383 = _- --- — -3263 —-1686 
E 3-700 1-389 oo a= — — — —-1345 

F 5-567 0-664 ~- — --- _ — -— 

Standard VI 
F pS i | 

k, ke A B C D E F 
A 3-367 2-168 — — 0-0659 — 1-2813 — 0-5986 — 0-3262 0-0948 
B 4-533 1-433 — — — 8084 — 0566 —-0772 —-4189 
Cc 2-467 2-945 —- — — —-0124 — 3711 —°4777 
D 2-667 1-883 — a —- — — 6676 — +5535 
E 2-767 1-631 — -- — oo a —-1949 

F 5-200 1-544 — — —- a — — 

Test for equality of mean ranks: 
mM, = Mz = 30, t= 4-777, 
E(t) = 0-629, V(t) = 0-177, 
2=0-14l, v = 4-46, 


x? = t/a = 33-9, 
a value which is highly significant for five degrees of freedom. 
Test for equality of coefficients of concordance : 
Mm, = Mm, = 30, t= 4-192, 
E(t) = —0-145, SD(t) = 1-553, 
(t— E(t))/SD(t) = 2-81, 
which is significant at the 1 % level. 


30-3 
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To get an impression of the degree of approximation in (15), the terms of (14) of order m-? were added 
to (15) to give an improved approximation for the variance. After considerable computation the 
improved value for the standard deviation was found to be 1-532, which is only slightly different from 
1-553 as obtained using formula (15). 

It appears that the Form V and Standard VI pupils do not have the same job hierarchy and Form V 
pupils agree among themselves more closely than Standard VI pupils. 


Miscellanea 


REFERENCES 


Cook, M. B. (1951). Bivariate k-statistics and cumulants of their joint sampling distribution. Bio- 
metrika, 38, 179-95. 

Davin, F. N. & Jounson, N. L. (1954). Statistical treatment of censored data. Part I. Fundamental 
formulae. Biometrika, 41, 228—40. 

FisHer, R. A. (1928). Moments and product moments of sampling distributions. Proc. Lond. Math. 
Soc. 30, 199-238. 

KENDALL, M. G. (1940). The derivation of multivariate sampling formulae from univariate formulae 
by symbolic operation. Ann. Eugen., Lond., 10, 392-402. 

KENDALL, M. G. (1950). Discussion on symposium on ranking methods. J. Roy. Statist. Soc. B, 12, 189. 

Lake, J. R. & MBau, G. G. (1960). Occupational preferences among male Bantu school children. To be 
published in J. Nat. Inst. Personnel Res. 

Stuart, A. (1951). An application of the distribution of the ranking concordance coefficient. Biometrika, 
38, 33-42. 


A note on the derivation of some exact multivariate tests 


By A. M. KSHIRSAGAR 


University of Manchester 


Williams (1952) has derived the conditional distribution of the squares of the sample canonical corre- 
lations 7? and the squares of the residual canonical correlations ¢; when the true discriminant function 
corresponding to the only non-zero canonical correlation, is eliminated. He has, however, not explicitly 
stated some of the arguments in the derivation. This note is intended to clarify these points, and treat the 
problem more generally. 

We consider a dependent vector variate 

x’ = (a4, ...»%y) 
and an independent vector variate VY’ = (Yrs ---rYe)s 


where p < q. These are taken to be the population canonical variables. The sample x, yj, (4 = 1, p;..., 
j=1,...,q;t = 1,...,n) with n degrees of freedom is divided in the usual way (see Bartlett, 1934) into a 
part with q degrees of freedom corresponding to the regression of x on y and the remaining part with n —q 
degrees of freedom. Let A and B be the matrices of the sum of squares and products corresponding to 
this division. Then they have independent Wishart distributions. This is so if the true canonical corre- 
lations p;, are all zero. If, however, p, is the only non-zero correlation, then A has a non-central Wishart 
distribution belonging to the ‘linear’ case (see Anderson, 1946). In any case, make the transformation 


(see Bartlett, 1947) KAK’ = WDW’ 
K(A+B)K’ =WW’, 


where K is the diagonal matrix with diagonal elements, (1 — pi), 1,..., 1; Dis the diagonal matrix of the 
quantities r and W = [w,,]. Then the joint distribution of W and D (see Bartlett, 1947, equations (4) 
to (7)) when all the p’s are zero is 


' 12 
o,|WW'ho-mexp] —5 »Y uy Jaw 
i 


or 

p p — >) Wo 
x C; I {(p)ke-2- (1 —rptoenrn II (r? —1?) 1 dr?, 
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(the w,; varying from — 0 to 00 except that w,; > 0), and 


p-1 
C, = mi put T(r —- 1TH -O1TR@—-a1 Tin —q—-4)))}- 
If p, is the only non-zero true canonical correlation, there is an extra factor 


2 (SA?)* (wi, 3+... + wi, r$)* T (49) 
—4A ee ae ee ee 
‘ Po at 22 T(3q+a) ‘ yo 


n 
where A? = pi 2 yi,/(1—p) 


in the joint distribution of W and D. If w’ = (w,,...,u,) and v’ = (v%,...,v,) are the sample canonical 
variables corresponding to x’ and y’, then a little consideration will show that 


x= K—Wu 


and hence 2, = (1—p?)! (w,,u,+...+W,,u,) is the true discriminant function, in terms of the sample 
canonical variables. Williams (1952) has derived the distribution of ¢;, the squares of the residual 
canonical correlations, when the relation between 2,, the true discriminant function and y is eliminated. 
The relationship is measured by 7, the square of the sample multiple correlation coefficient between x, 
and y. This is obviously (w?,r} +... + w},72)/(wi, +... +wi,). Williams has derived the distribution by 


lp’ p 
p 
transforming from w,; (¢ = 1,...,p) to ¢;(j = 1,...,p—1) ands = } w?, in the distribution of the w,;, 
1? i=1 
which he simply takes as const. exp — (5 2 ut) . But rigorously, as we have seen above, the distribution 


of w,; must be obtained from the distribution of W, viz. 
const. | WW’ |i"—») ete? 


multiplied by the extra factor given in (1) above, by integrating out the other w’s. Thus, as Bartlett 
(1947) has observed, the distribution is normal, except for the ‘linkage’ factor, const. | WW’ |tn-), For 
integrating out the other w’s a transformation may be made to c,; and 6,; as in Bartlett’s (1947) paper. 
It will then be observed, that the distribution of s is not a y? with p degrees of freedom as given in 
Williams’s (1952) paper, but is elevated to n degrees of freedom due to the ‘linkage factor’. This has been 
observed by Bartlett (1947). However, since finally, for the distribution of ¢’s, s is to be integrated out, 
the desired distribution of r? and ¢; is as given in Williams’s (1952) paper. It is 


const. II{(r?)#@-»-» (1 — r2)Km-a-2)} | TT (r?—-r?) TT (da—¢;)| 
i+j h+k 
TI(1—$,)#? |11(r7- $,)|# 
x eH’ F(4n, 4q, $429) Ur? Td¢,, 
where (1-9) 1(1—$,) = M(1—7}). 
The distribution of 7 is const. 9-2) (1 — 4)" —9-®) e~4* F(4n, 4q, $029) dy. 





The conditional distribution of r? and ¢,, when 7 is fixed, is therefore 

const. IT(r?)#a—?—0 TT(1 — g,)8"—?-9-) | TT (r?- 7?) TT (Pn — x) | Ildr? I1d¢,, 
ae i ee h+k : = 

n¥o-® | TT(r? — b,)|* dy 


(One of the set 7? and ¢, must be replaced by 7, using the relation between them; but to preserve sym- 
metry, this is not done.) This conditional distribution does not involve p,; 7 is thus a sufficient statistic. 
This is why Williams (1952) is able to ignore the extra factor (1) and treat the w,, as independent normal 
deviates. 

Williams has derived the relation between ¢ and 7? and w’s by employing a geometrical argument 
involving principal semi-axes of an ellipsoid. This can alternatively be obtained, analytically, by 
observing that the ¢’s satisfy the determinantal equation 


|-—(1-¢) Oyy.e, + Cory. = 0, 








where the notation of Bartlett (1939) is used. When the sample canonical variables u and v are used, 
this becomes 


|—(1-¢) Cov.vet+Cov.ul =0 
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as x,, the true discriminant function, is proportional to l’u, where 


V=(l,,...,l)) and 1, = w,,/(w?, +... +w,)t 


Obviously, C,,.,, = I—D and C,, +, = (6;;—7;7;1,l;) where 6;; is the Kronecker delta. Then the deter- 
minantal equation simplifies to 


This is the required relation. 


The author is indebted to Prof. M. S. Bartlett for much helpful advice. 
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Estimation from a linear Markov process 


By N. GILBERT 
John Innes Horticultural Institution, Bayfordbury, Hertford, Herts 


This note is concerned with the feasibility of analysing growth curves as Markov chains. The idea was 
to transform to approximate linearity (and equality of error variance) and then fit a linear Markov 
process including a linear regression 

Yi = M+ fi—}(n+1)} +2; 


where U; = 1X1 + &j, 
€, is N(0, 0”), e; is N(0, 1 —r?o?) 


and n is the number of observations in the chain. This note describes the results of applying least-squares 
analysis (including the end-correction of Quenouille (1957) in the denominator of 7) to a set of artificial 
data. The least-squares equations were solved iteratively, continuing until # differed from its value in the 
previous cycle by less than 2-*. Convergence is rapid except in a few cases for large values of r; clearly 
there is no unique solution when 7 = 1. The calculations were made by the Rothamsted electronic 
computer. It was programmed to convert a set of random normal deviates x, taken from Rand Corpora- 
tion (1955), into a Markov chain y 
¥=TYAtVA-Y)ay, YW=% 


x, is N(0, 1), 


and then to estimate m, b and r. 50 sets of 25 ~’s were used throughout so that, for any given value of n, 
the y’s were derived from the same x’s for each value of r and, further, the x’s were the first n values from 
each set of 25. It was not necessary to introduce artificial values for m and b as the solutions obtained in 
this case would be identical with those for m = 6 = 0, apart from the increase of m and 6 by the values 
used for m and b. The results answer two questions: (1) do direct estimates of mean and regression differ 
seriously from estimates that recognize the correlation of errors? and (2) is # accurate enough to be used 
as an indicator of the organism’s ability to recover from accidental deviations? The answer to the first 
question is ‘no’ and to the second, ‘not unless n is about 20 or more’. 

The mean values of m and 6 for each combination of n and r all differed insignificantly from 0, except 
in the case of n = 15 where it is clear that the original data showed a chance disturbance. 
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Averages of m and 6 for n = 15 








100m 1006 

t A Y tw A— ‘ 

r Markov Direct Markov ’ Direct 
—0:8 0-87 + 1-25 1-15 + 1-43 0-54 + 0-30 0-96 + 0-47 
—0-4 1-58 + 2°46 1-61 + 2°50 1-11+0-56 1-30 + 0-65 
0 2-34+ 3-70 1-98+ 3-74 1-71+0-81 1-74+ 0-83 
0-4 2-98 + 5-46 1-76 + 5°58 2-444 1-09 2-30 + 1-08 
0-8 — 2-59 + 9-23 — 3-33 + 9-64 3-07 + 1-32 2-30 + 1-37 


The behaviour of 7 is explained by the consideration that, for r = 0, every x has equal importance, 
whereas as r approaches + 1 the first x dominates the series. The estimated standard errors for direct 
estimation, 7 = 0, may be compared with their theoretical values 3-65 and 0°85. It is clear that there is 
little to choose between the direct and Markov estimates, except perhaps for extreme values of r which 
would not be encountered in nature. This is hardly surprising as the two kinds of estimate differ only in 
the weighting of the first and last observations. I am grateful to the Referee for pointing out that, on 
such theoretical considerations, this weighting would not improve the accuracy of m and 6 very much 


even if an unbiased estimate of r were used. The distributions of m and 6 are algebraically quite tract- 
able, but that of 7 is best dealt with numerically. 


Means and standard deviations of 7 


n=9 n= 15 n = 15 (direct) n = 20 n = 25 
re eee ’ ——- —_—_ 
r Mean S.D. Mean S.D. Mean S.D. Mean S.D. Mean S.D. 
—0:8 —0:79 0-18 —0-78 0-17 —0-76 0-17 —0:79 0-15 —0-81 0-12 
— 0:6 — 64 *26 — 65 -20 — _- — +65 18 _ = 
— 0-4 — 51 -30 —-51 +22 —-50 21 — +49 21 —-48 “19 
—0-2 —+39 31 — +36 23 — — —+33 22 — we 
0 —:27 33 — +20 +24 —-20 +23 —-16 +23 —-14 +23 
0-2 —-16 33 —-05 25 — —_— 00 24 — — 
0-4 — 06 35 -09 26 -09 25 17 25 20 24 
0:6 02 36 22 26 — — 32 25 — = 
0-8 06 37 33 27 *30 24 47 24 51 23 


The ‘direct’ values of # for n = 15 were obtained from the residuals after fitting m and 6 direct, i.e. are 
the values after the first cycle of iteration. The values of # show a negative bias and, more important, a 
fairly linear regression on r with a coefficient less than 1. Thus the difference in # between r = + 0-4 and 
— 0-6 is 0-82 for n = 20 and only 0-58 for n = 9. Taking into account the size of the standard deviations, 
there is little hope of establishing consistent differences between values of r unless n is 20 or more. It 
appears, therefore, that Markov analysis offers no advance on the simpler methods of estimation of 
growth parameters (e.g. Leech & Healy, 1959) and a chain of at least 20 observations is required for 
useful estimates of the error autocorrelation. 
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Corrigendum 


Biometrika, (1960), 47, pp. 202-3. 


‘Some numerical results for waiting times in the queue £,/M/1.’ By C. Burrows. 


p- 202, 2nd line above Table 1 
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Probability and Statistics. (The Harald Cramér Volume). Edited by ULF GRENANDER. 
New York: John Wiley and Sons Inc.; London: Chapman and Hall; Stockholm: 
Almquist and Wiksell. 1959. Pp. v+ 434. 100s. 


This book is a collection of research papers on probability and statistics presented to Prof. Harald 
Cramér for his 65th birthday. The titles of the papers and the authors are as follows: Some scaling 
models and estimation procedures in the latent class model (T. W. Anderson); The impact of stochastic 
process theory on statistics (M. S. Bartlett); A Markov chain theorem (J. L. Doob); Design of linear 
experiments (G. Elfving); On combinatorial methods in fluctuation theory (W. Feller); The restricted 
chi-square test (E. Fix, J. L. Hodges and E. L. Lehmann); Some non-linear problems in probability 
theory (U. Grenander); Some remarks on stable processes with independent increments (M. Mac); 
Unitary dilations of Markov transition operators (D. G. Kendall); Construction du processus de W. 
Feller et H. P. McKean en partant du mouvement Brownien (P. Lévy); Cramér’s theorem on monotone 
matrix-valued functions and the Wold decomposition (P. Masani); Non-linear prediction (P. Masani 
and N. Wiener); Optimal asymptotic tests of composite statistical hypotheses (J. Neyman); Sequential 
estimation of the mean of a normal population (H. Robbins); Statistical analysis of stochastic 
processes with stationary residuals (M. Rosenblatt); A survey of results in the collective theory of 
risk (C. O. Segerdahl); An introduction to the measurement of spectra (J. W. Tukey); Non-parametric 
statistical inference (S. 8S. Wilks); Ends and means in econometric model building (H. Wold). 

The majority of the papers are concerned with one aspect or another of stochastic processes, possibly 
a reflexion on present day preoccupation with that topic. Prof. Cramér has had presented to him an 
interesting collection of essays and statisticians all over the world will join with the authors in wishing 


him many happy returns. F. N. DAVID 


Allgemeine Methodenlehre der Statistik. By Joann Pranzacu. (I. Elementiire 
Methoden unter besonderer Beriicksichtigung der Anwendungen in den Wirkschafts- 
und Sozialwissenschaften) (Band 746/746a of Sammlung Géschen). Berlin: Walter de 
Gruyter and Co. 1960. Pp. 205. 5.80 DM. 


This small (4 x 6 in.) handbook contains a concise development of the elementary statistical tech- 
niques used in the descriptive treatment of numerical data. The author has managed to include a 
remarkably comprehensive range of techniques in a very small space, without sacrificing clarity, or 
adequacy, of treatment. The book is addressed primarily to users of statistics in the fields of economic 
and social science. For students working in these fields, the book provides a very convenient summary 
of available elementary statistical methods: the accompanying discussion should even prove adequate 
for many students learning a modicum of statistics for certain professioral examinations. 

Chapter headings are as follows: 

(1) Fundamental concepts. (2) Frequency distributions. (3) Parameters. (4) Statistical errors. 
(5) Sampling methods in economic and social statistics. (6) Measures of condition: measures of move- 
ment. (7) General theory of measurable characters. (8) The calculation of index numbers. (9) Some 
examples of index numbers. (10) The analysis of time series. (11) The procurement of numerical data. 
(12) The computational treatment of numerical data. (13) The representation of numerical data. 

The last three chapters are grouped together as a ‘Technical Appendix’: chapter 13 is, in fact, mainly 
concerned with diagrammatic representation of data, pictorial examples being provided. 

Chapter 7 is of rather special interest. It emphasizes the need for care in deciding upon what is to be 
measured, and should be a good influence on the work of investigators in economic and social science, 
if they study this book. N. L. JOHNSON 
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Mathematical Statistics. By J. N. Kapur and H. C. Saxena. Delhi, Jullundur and 
Lucknow: S. Chand and Co. 1960. Pp. 400. Rs. 10. 


The book is based on the authors’ lectures at Delhi University, and it is aimed primarily at University 
students in the Indian subcontinent. The level of mathematical sophistication is (no doubt deliberately) 
kept at a very moderate level and the book is chiefly remarkable for the very large number of exercises 
it contains. The authors claim that ‘books on Statistics have so far tended to give either very difficult 
...or only very easy exercises, and, in general, these exercises are too few...’. In the present work 
there are some 600 straightforward exercises, many of them taken from M.A. and M.Sc. papers of 
Indian universities, many with solutions provided; and in addition there are a large number of worked 
examples in the text. 

This feature is typical of the authors’ approach, which, clearly, aims at producing a teaching book 
which will enable even the most plodding of students to pass examinations. 

The contents are best illustrated by giving the chapter headings: 

Frequency distributions and measures of location; Measures of dispersion, skewness and kurtosis 
moments; Theory of probability; Mathematical expectation, moment generating and cumulative 
functions; Special discrete probability distributions; Continuous probability distributions; Special 
continuous distributions; Method of least squares and curve fitting; Correlation and regression; 
Multiple and partial correlation; Theory of sampling; Exact sampling distributions; Tests of signifi- 
cance based on ¢, F and r distributions; Tests of significance based on the chi-square distribution; 
Statistical theory of estimation; Testing of hypotheses, sequential analysis, distribution-free methods. 

In addition there are two appendices, one on beta and gamma functions and one on finite differences. 
Tables are provided of normal ordinates and areas, percentage points of ¢ and x”, and 5 and 1 % values 
of F. 

It is pleasing to see that the Poisson distribution is presented in terms of the Poisson process as well 
as the usual approximation to the Binomial; and that the definition of independence does not merely 
refer to the factorization of the joint distribution function, but also makes the necessary remarks 
about the ranges of definition. On the whole in the greater part of the book, the authors undoubtedly 
succeed in achieving their aim, keeping the style unpretentious (and often non-rigorous) and keeping 
the topics discussed very much within ‘elementary’ bounds. 

Those parts of the book dealing specifically with estimation and inference cannot, however, be 
regarded as entirely satisfactory. The approach to significance tests, exemplified by the following 
extract, may possibly encourage a rather dogmatic and uncritical attitude in the student: ‘If our 
calculated value of |¢| exceeds ty.5,, we say that the difference between % and vy is significant at 554 
level of significance; if it exceeds t).9,, the difference is said to be significant at 1% level or just 
highly significant. If |t] < t).9,, we say that the data is consistent with the hypothesis that is the mean 
of the population’ (p. 284). In the chapter dealing with estimation, the probability associated with 
a confidence interval is described as a fiducial probability and there is no discussion of the differences 
between the fiducial and the confidence concepts. Finally, the chapter on least squares is very dis- 
appointing. There is nothing about any optimum properties of Least Squares estimates, nothing about 
their accuracy, indeed no indication that Least Squares procedures are in any sense statistical. Frankly 


this chapter is unworthy of the book. E.H. LLOYD 


Analysis of Straight-line Data. By Forman 8. Acton. New York: John Wiley and 
Sons Inc.; London: Chapman and Hall Ltd. 1959. Pp. xiii+ 267. 72s. 


On the dust-jacket, and perhaps also in the Preface, the author does his book less than justice by 
saying that it ‘...thoroughly covers one important aspect of engineering statistics. ..’. The analysis 
of experimental data which can be associated with the linear model—or for which a linear model 
provides a reasonable representation—extends beyond the confines of engineering. Indeed, many of the 
examples are from fields far removed from the world of engineering. Prof. Acton’s book is, in fact, a 
good example of that developed stage in the literature of a subject: the monograph. In this case, 
a statistical concept has been described—no less acceptable to the practising statistician than the 
monograph which deals with the areas of application for the tools found in one corner of the statistical 
tool box, or the monograph which deals with the statistical methods appropriate to one field of 
application. 
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The author says that his book, grown from a small pamphlet, is a discussion of techniques that have 
been proved both pertinent and useful. Some of the classical approaches are excluded, however, on 
the ground that ‘they encourage an unthinking mechanical solution to the problem of straight-line 
fitting’. It is because the experimentalist needs to think about the structure of his experiment that the 
author makes a strong plea for the experimenter to try and use the methods himself. The only practical 
difficulty may be that, even with Prof. Acton’s book to guide him, the experimenter may be so involved 
that it could still be preferable to him to consult a statistician rather than face the 250-odd pages of this 
book and the channels to which they would lead. If this was to be so then it would be a pity because he 
would miss reading an attractive style of writing. This reviewer is sure that the ‘Jacobean’ on page 
122 is there through a misprint since the author’s brand of dry humour would scarcely encompass this 
on any terms! 

The book begins with a short chapter on the choice of (linear) model and then proceeds to two chapters 
dealing with the classical model—where x is known without error and y homoscedastic—and the 
regression model where there are several values of y for each known 2. In the first of these two chapters, 
the second section (pages 19-53) dealing with the setting of confidence limits appears to this reviewer 
to be particularly valuable. Chapters 4 and 5 deal with samples from bivariate normal populations and 
the problem of regression with both x and y measured with error. This leads to the more general case 
(in chapter 6) of several regression lines and the use of analysis of variance. Some of the shoulder- 
headings in these chapters are examples of the author’s lively sense that all this is by no means tedious: 
‘The 99-44% pure extractor’ method and ‘Hindsight heresy’. 

In chapter 7 the opening paragraph is as distinguished a tilt at the desire of some to pursue the linear 
form as others which have been written on the hallowed normality of a distribution. The chapter deals 
with the method of orthogonal polynomials for dealing with data which cannot adequately be repre- 
sented by a straight line. This, together with the succeeding chapters, (8) on the use of transformations, 
(9) rejection of unwanted data and (10) on cumulative data, confirms the essentially practical approach 
of this book. These are short accounts of important problems for which adequate answers have not 
yet been found. 

There is an appendix of useful tables—some from formally unpublished material of Prof. Tukey— 
the usual index, a list of forty-two quoted references and an Additional Bibliography of annotated 
references not quoted in the text. In this latter connexion it is good to see included the pre-war paper 
by Prof. R. G. D. Allen, Economica (1939), 6, 191-204, as indication of the wide experience which 
has gone into the preparation of this monograph. The diagrams throughout are excellent and it may 
comfort others to know that even the distinguished house of Wiley is subject to the same kind of printing 
hazards as most: a figure 1 has dropped-out of the denominator under the root sign in the first term of 
the first expression on page 133. 

This book may not be suitable for students or the recently qualified statistician, but the general 
body of practising statisticians will do well to note and use this book as a reference point for statistical 
expertise on its chosen topic. WM. R. BUCKLAND 


Methods of Correlation and Regression Analysis. Third Edition. By M. Ezexren 
and K. A. Fox. New York: John Wiley and Sons Inc.; London: Chapman and Hall. 
1959. Pp. xv+548. 88s. 


The first two editions of this book, written by Prof. Ezekiel, alone appeared in 1930 and 1941 and 
are familiar to many statisticians. In this third edition the material has been brought up to date by 
emphasizing regression rather than correlation and by the addition of a new chapter (24) on fitting 
systems of two or more simultaneous equations. There is also fuller treatment of the analysis of variance. 
As in previous editions the book sets out how to apply techniques. It is a useful ancillary tool for any 
research worker who is faced with the problem of studying the relationships between two or more 
variables. F. D. DAVID 


Modern Statistical Methods. By P. 0. Jonson and R. W. B. Jackson. Chicago: 
Rand McNally and Co. 1959. Pp. viii+509. $8.00. 


This book is designed to meet the needs of students in the social sciences who know no statistical 
methods and who require to learn enough to be able to treat their practical data. The topics treated are 
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reduction and classification of data, a little probability, likelihood, y?, tests for significance of means 
and variances, a little analysis of variance, some non-parametric tests, estimation, reduction of bivariate 
data and regression, multivariate data and partial regression, design and analysis of investigations. 
Brief tables of the normal integral, of y?, of t and of F are included. The book is well and clearly written 
with many useful numerical illustrations drawn from the field of the social sciences. Care has been 
taken to give references so that the student who wishes to read further or more deeply about the tech- 


niques cited will be able to do so. The book can be recommended. F. N. DAVID 


Introduction to Probability and Statistics. By G. W. McE.eratu and B. W. 
LinpGREN. New York and London: Macmillan Company, New York. 1959. Pp. xiii+ 
273. Price 44s. 


This is yet another elementary textbook on probability and statistics. There are twelve chapters and 
a useful appendix containing the more common statistical tables. The authors begin with fives chapters 
on the elements of probability—Simple models, Random variables and distribution functions, Discreet 
distributions, Continuous distributions and Sums of random variables. They turn then to the observa- 
tional tie-up, and give a chapter on sampling and one on the presentation and description of data. 
There follow chapters on testing statistical hypotheses, testing and estimating location, testing and 
estimating variability, and two-sample tests. The last chapter touches on sequential tests, regression, 
analysis of variance and decision theory. 

The delineation is clear, if a trifle loose in places, and the book will doubtless serve a useful purpose. 


F. N. DAVID 


Rapid Statistical Calculations. By M. H. QuEeNnoumue. London: Charles Griffin 
and Co. Ltd. 1959. Pp. xv+81. 10s. 6d. 


This book is a summary of the tests which are in common statistical practice, and their application 
to numerical examples. It is divided into three sections: A, Methods involving mean level or scatter 
of groups of observations. B, Methods of comparing frequencies or proportions. C, Methods involving 
association. There is an appendix containing brief significance tables for the normal, t, y? and F 
distributions, for the correlation coefficient, the number of points falling in a quadrant, the number 
of runs, and the number of pairs of points falling on the same side of the medial line. For students 
and research workers trying to teach themselves statistics it will be found a useful auxiliary to any 


elementary theoretical textbook of statistical methods. F. N. DAVID 


Darwin’s Biological Work. Some Aspects Reconsidered. Ed. by P. R. BELL. 
London: Cambridge University Press. 1959. Pp. xiii+ 343. 40s. 


The Darwinian centenary has seen the appearance of a minor spate of books on Darwin, Darwinism 
and evolution in general. Inevitably some of these were repetitive, others of indifferent scientific merit. 
Thus the prospective reader may well be sceptical of further Darwiniana. The present volume, however, 
differs by intent and content from the books referred to above and may well please a wide readership. 

The plan of the book is to describe Darwin’s contributions to various fields of biology and to review 
the progress in these fields during the past one hundred years. It is an interesting approach, although 
not all of the contributors to the volume followed it closely, adding Darwin as an afterthought instead of 
a Leitmotif. 

There are six essays in the volume. The first, by the editor, on ‘The movement of plants in response 
to light’, is a thorough historical review of the development of our present-day views on the mechanism 
of the response of plants (mostly seedlings) to light. Approaching this subject from total ignorance I 
found much informative material, but had some difficulty in co-ordinating all the many facts and 
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theories. Less citation of factual references and more sectional summaries could possibly have improved 
its readability. 

The article on ‘Palaeontology and evolution’, by J. Challinor is perhaps the finest in the volume. 
While it contains little on Darwin as a palaeontologist, it does present a perceptive modern view of the 
contribution of fossil study to a knowledge of evolution. Dr Challinor is very critical of the palaeonto- 
logical evidence often cited in support of evolutionary theories by less discerning colleagues. His views 
of sampling, recognition of trends and classification may not meet with their whole-hearted approval. 
I found his thoughts on these and other issues stimulating and much to my liking. I am not sure whether 
the article gains by the description of the fossil evidence in various systematic groups; in any case this 
discussion has been wisely placed at the end, where also can be found a geological time-scale which will 
be much appreciated by those, such as this writer, who cannot always recall the entire sequence. 

Prof. Haldane, in contributing an article on ‘Natural selection’, has had the difficult task of con- 
densing this vast subject into 49 pages. The result is a readable and stimulating essay, covering largely 
familiar ground but with a section cn rates of evolution containing novel inferences on the subject based 
on simple genetic assumptions. Space limitations prevent their discussion here; much of Haldane’s 
reasoning follows along classical selectionist lines. In the opinion of this reviewer insufficient attention 
is paid to stochastic evolutionary processes, population structure and fluctuation, and to distinguishing 
catastrophic and selective effects of environmental forces. While surely everyone admires Kettlewell’s 
magnificent study on Biston betularia, yet another reproduction of his photographs in this volume is 
bound to engender ennui among the biological public. 

P. Marler discusses ‘Developments in the study of animal communication’. This copiously illustrated 
chapter discusses mechanisms of communication with emphasis on the vertebrates and contains 
fascinating descriptions of various behaviour patterns. The largely original analysis of specific, geo- 
graphical and individual variation in bird songs will be particularly appreciated. 

‘Cross: and self-fertilization in plants’, by H. L. K. Whitehouse, follows the plan of the volume most 
admirably and is a lucid, well-organized account of the subject. Darwin’s numerous contributions to 
this field both by experiment as well as theory will greatly impress the reader. The section on the early 
history of genetics, well known to most, could possibly have been shortened or omitted. On reading 
through the section on the advantages of heterozygosis one is struck by how little really is known about 
the relative success of outbred and inbred plants under natural conditions ; yet many of the speculations 
regarding the origins of mechanisms for cross-fertilization hinge upon these facts. 

The volume concludes with a scholarly article by J. 8. Wilkie on ‘ Buffon, Lamarck and Darwin: The 
originality of Darwin’s theory of evolution’. 

The book is well illustrated. Regrettably, citations to the literature are by number, with all references 
grouped by chapter at the end of the book, a particularly unhandy system. There is no index. 


ROBERT R. SOKAL 


Statistical Methods in Biology. By N. T. J. Battey. London: English Universities 
Press. 1959. Pp. ix+199. 25s. 


This is a textbook on elementary statistical techniques. The topics covered are the binomial, normal, 
and Poisson distributions, significance tests (t, x2, F and r) contingency, correlation and regression, 
elements of the analysis of variance and of factorial experiments, partial correlation and regression. 
No attempt is made (deliberately) to indicate the derivation on any technique. The method of exposition 
appears to be modelled on that of R. A. Fisher’s Statistical Methods for Research Workers, but it is 
unlikely that many will be tempted away from that old and tried classic. The numerical examples illus- 
trating the theory are humdrum. The reviewer for one is tired of the distribution of stature, the distri- 
bution of yeast cells in a haemacytometer (Student’s data) and the distribution of weights of fathers 
and sons. Stature and the weights of potatoes can each be described as biological measurements but 
one of interest to few biologists, and in view of the title it is possibly unfortunate that a greater effort 
was not made to choose examples which occur in biological work. 

This book adds one more to the mass of elementary statistical texts which are now on the market. 
The time is almost ripe for a monograph which will help the student to choose between them. 


F. N. DAVID 
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String Figures and Other Monographs. By W. W. R. Batt, J. Petersen, H. 8. 
CarsLaw and F. Casorit. New York: Chelsea Publishing Co. 1960. Pp. vi+72, 102, 
v+179, vii+ 136. $ 3.95. 


This is a combined reprinting of four monographs. 

The first is W. W. Rouse Ball’s ‘String Figures’. String figures are designs made by weaving and 
twisting loops over one’s hands; they may either be pleasant in themselves, or illustrate some action 
or story, or create a surprise effect. Rouse Ball gives examples of such figures from all parts of the world, 
and references to further literature on the subject. 

The second is Petersen’s ‘Methods and Theories for the Solution of Problems of Geometrical construc- 
tions applied to 410 Problems’. This deals with problems soluble by the use of a straight edge and com- 
pass. An astonishing variety of problems are reduced in effect to two principles. The first is: ‘Imagine 
one of the given conditions. ..removed, and seek the loci of the points of the figure thus rendered 
indeterminate’. The required figure can then be found by means of the intersection of two such loci. 
The second principle is that of transformation of the figure, by translation, magnification, rotation, 
inversion, etc., into a new figure whose construction is already known. The author concludes with a 
few remarks on whether a given problem can be solved with ruler and compasses. 

The third monograph is Carslaw’s ‘The Elements of Non-Euclidean Plane Geometry and Trigono- 
metry’. The scope of this book is well-described by the title. It is very clear and thorough, including 
both hyperbolic and elliptic geometry, and with full account of the history. Although a modern 
book might prefer to approach the subject via projective geometry, Carslaw’s book is interesting in 
following more nearly the historical line of development, and is an excellent introduction to and general 
account of the subject. 

The final monograph is Cajori’s ‘A History of the Logarithmic Slide Rule and allied Instruments’. 

The publishers explain that the essential reason for printing all four books in a single volume is 
economic; it would cost almost the same to print any one of them separately. The result is to get an 


interesting miscellany at a low price. CEDRIC A. B. SMITH 


Journal of Research. B. Mathematics and Mathematical Physics. Vol. 64B, No. 1. 
January to March 1960. Washington: U.S. Department of Commerce, National 
Bureau of Standards. 1960. Pp. 82. Subscription Price: $2.25 (U.S.A.) or $2.75 
(elsewhere). 


Starting from 1960, this Jowrnal is to be published in four separate sections, corresponding to subject 
matters field. Section B, dealing with Mathematics and Mathematical Physics, will include to, cs in 
mathematical statistics, theory of experimental design, numerical analysis, theoretical physics and 
chemistry, and the logical design and programming of computers., 

The first issue of Section B under the new scheme contains two Selected Bibliographies of Statistical 
Literature (1930-57) prepared by Lola 8. Deming: 

I. Correlation and Regression Theory, pp. 55-68. 

II. Time series, pp. 69-82. 

The titles and references were extracted from a card file, kept in the N. B. S. Statistical Engineering 
Laboratory, made up of abstracts taken from Zentralblatt fii; Mathematik (1930-39) and from Mathe- 
matical Reviews (1940-57). 

Further bibliographies for other subject groups are promised. 


Sampling Inspection Tables. Single and Double Sampling (second edition). By 
H. F. Dongs and H. G. Romie. London: Chapman and Hall Ltd.; New York: John 
Wiley and Sons Inc. 1959. Pp. xi+60 (text), 195 (tables). 64s. 


This is the second edition revised and expanded of sampling inspection tables first produced in 1944. 
The additions are: 
(i) Use of the tables when rejected lots are not screened. 
(ii) Choosing a sampling plan for a specific application. 
(iii) A new chapter on the ‘operating characteristic curve’ (OC) 
(iv) OC curves for all the single and double sampling tables. : 
The additions have been made at the request of users who have found this book of practical importance. 
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Introduction to Mathematical Statistics. By R. V. Hoce and A. T. Craic. New York and 
London: The Macmillan Company, NewYork, 1960. Pp. ix+ 245. 


Type-token Mathematics. By G. Herpan. The Hague, Holland: Mouton and Co. 1960. Pp. 448. 
Gld. 54 or £5. 2s. 


Quantative Genetics. By D. 8S. Fatconer. Edinburgh: Oliver and Boyd. 1960. Pp. ix+365. 35s. 


Genetical Research. Vol. 1, No. 1. London and New York: Cambridge University Press. 1960. 
Pp. 172. Subscription (three parts annually) £5 or $17.50. 


An Introduction to Infinitely Many Variables. (Griffin’s Statistical Monograph No. 6.) By ENDERS 
A. Roxprnson. London: Charles Griffin and Co. 1959. Pp. 132. 28s. 


An Introduction to Mathematical Statistics. By H. D. Brunx. Massachusetts: Ginn and Company 
1960. Pp. xi+ 403. $7.00. 


Annual Epidemiological and Vital Statistics 1956. (Bilingual edition.) World Health Organiza- 
tion, Geneva, Switzerland. (U.K. Sales Agent, H.M.S.O.) Pp. 705. 60s., $12 or Sw. fr. 36. 


Essential Tremor. A Clinical and Genetical Population Study. By Tacr Larsson and 'TorsTtEN 
Szs6GREN. Copenhagen: Munksgaard, for the Department of Psychiatry, The Caroline Institute, 
Stockholm. 1960. Pp. 176. Sub. 65 Danish Kronor. 


Principles and Procedures of Statistics. By Robert G. D. STEEL and James H. Torrie. London, 
New York and Toronto: McGraw-Hill Publishing Co. 1960. Pp. 481. 81s. 6d. 


Theory and Solution of Ordinary Differential Equations. By DonaLp GREENSPAN. New York 
and London: The Macmillan Company, New York. 1960. Pp. 148. 38s. 6d. 


La Biométrie. Que sais-je. (Le point des connaissances actuelles No. 871.) By EUGENE SCHREIDER. 
Paris: Presses Universitaires de France. 1960. Pp. 126. 


The Elliptic Functions as they should be. By ALBERT Eacie. Cambridge: Galloway and Porter. 
1958. Pp. 508. 45s. 


Biometrical Genetics. Proceedings of an International Symposium, Ottawa 1958, sponsored by the 
Biometrics Society and the International Union of Biological Sciences [International Union of 
Biological Science Series B (Colloquia), No. 38 of Monographs on Biometry]. Ed. Oscar 
KEMPTHORNE. London, Oxford, New York and Paris: Pergamon Press. 1960. Pp. 150. 42s. 


Biométrie-Praximetric. Vol. 1, No. 1. Brussels: Presses Universitaires de Bruxelles, for the Associa- 
tion des Biometriciens ie Belgique et du Congo Belge Societé Adolphe Quetelet. 1960. Pp. 58. 
Subscription 500 Belgian Francs p.a. +5 francs overseas. 


Recherche et Expérimentation en Agriculture. Vol. 2. Methodes Statistiques en Biologie 
et en Agronomie. By A. VEssEREAU. Paris: J. B. Bailliére et Fils. 1960. Pp. 538. 55 new 
French francs. 


Modern Mathematics. An Introduction. By Samuet I. Atrwercer. New York and London: 
The Macmillan Company, New York. 1960. Pp. xii+ 462. 47s. 


Special Functions. By Esru D. Ratnvitte. New York and London: The Macmillan Company, New 
York. 1960. Pp. xii+365. 82s. 


Grundlagen der Analysis. By Epmunp Lanpav. New York: Chelsea Publishing Co. 1960. Pp. 173. 
$1.95. 


Prontuari per Calcoli Statistici. Tavole numeriche e complementi. By Sitvio VIANELLI. 
Palermo, Italy: Ed. Abbaco. 1959. Pp. 1543. Lire 16,000. 
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Introduction to Congestion Theory in Telephone Systems. By R.Sysxr. Edinburgh and London: 
Oliver and Boyd, for the Automatic Telephone and Electric Co. 1960. Pp. xvi+ 742. £5. 5s. 


Modern Probability Theory and its Applications. By Emanvet Parzen. New York: John 
Wiley and Sons Inc.; London: Chapman and Hall. 1960. Pp. xv +464. 86s. 


Elementary Statistics. Py Paut G. Hort. New York: John Wiley and Sons Inc.; London: 
Chapman and Hall. 1960. Pp. vii+261. 44s. 


An Introduction to Experimental Design. By Wiit1am S. Ray. New York and London: The 
Macmillan Company, New York. 1960. Pp. x+ 254. 45s. 6d. 


Probability. An Introduction. By Samurt GotpBere. U.S.A. and London: Prentice Hall Inc. 
1960. Pp. xiv+ 322. 54s. 


Statistiche Methoden des Populationsgenetik. By Henri Louris Leroy. Basal and Stuttgart: 
Birkhauser Verlag. 1960. Pp. 397. 67.50 Swiss francs. 


Studii si Cercetari Matematice. Vol. 11, No. 1. Bucharest: Academia Republicii Populaire 
Romine. 1960. Pp. 280. 
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